New AI System Developed to Translate Brain Activity into Text

Scientists at the University of Texas at Austin have created the latest artificial intelligence tool that can convert a person’s brain activity into text while listening to a story or silently imagining it. This AI system called the Semantic Decoder, can help people who are mentally aware but physically unable to speak, such as those who have had a stroke or are suffering from psychosis.

Development of the AI System:

The Semantic Decoder system is based on the Transformer model, which powers Open AI’s ChatGPT and Google’s Bard. The system does not require surgical implantation and participants do not have to use only prescribed words.

The Process:

The system uses an active MRI scanner to measure brain activity and then undergoes extensive training of decoders. Participants pay attention to a podcast for hours withinside the scanner. Then, with the aid of using being attentive to a brand new tale or imagining the tale being told, the gadget generates textual content from mind pastime alone.


The outcomes aren’t phrase-for-phrase transcripts, however rather, seize what’s being stated or thought. The decoder can screen a participant’s mind hobby and bring textual content that intently suits the supposed which means of the unique phrases approximately 1/2 of the time. For example, a participant would hear a speaker say, “I don’t have my driver’s license yet,” and their thoughts would be translated as “She hasn’t even started learning to drive.

Concerns about Potential Misuse:

The researchers have addressed capacity worries approximately the misuse of this technology, asThe interpreting best works with cooperative members who volunteered to educate the decoder. The researchers have also taken measures to avoid the misuse of technology. Practical


The Semantic Decoder system is currently impractical for use outside the laboratory because of its reliance on the time it takes to set up an fMRI device. However, the researchers believe that this work should be complemented by other, more portable brain imaging systems, such as bi-functional near-infrared spectroscopy (fNIRS).


The development of this new AI system can help those who are physically unable to speak but are mentally aware. With its non-invasive nature, the Semantic Decoder can be an important tool for those who need assistance in communicating their thoughts and ideas.

About The Author

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts