AI Decodes Brain Waves of Paralyzed Individuals into Real-Time Audio

A man with paralysis is connected to a brain-computer interface system

Lisa E. Howard/Mitely Wairagkar et al. 2025

Men who have lost their ability to speak can engage in real-time conversations and even sing using brain-controlled synthetic voices.

The brain-computer interface captures neural activity through electrodes implanted in the brain, instantly creating audio sounds that match intended pitch, intonation, and emphasis.

“This represents a breakthrough in instantaneous speech synthesis, achieving this within 25 ms,” says Sergei Stavisky from the University of California, Davis.

While advancements are needed to improve speech clarity, Maitreyee Wairagkar, also at UC Davis, notes that the individual who lost his speech due to amyotrophic lateral sclerosis expresses happiness and feels that he has found his true voice.

Existing speech neurospheres that utilize brain-computer interfaces typically require a few seconds to convert brain activity into sound. Stavisky mentions that this delays natural conversation and if the connection falters, it can feel like speaking on a poor-quality phone call.

To create a more seamless speech experience, Wairagkar, Stavisky, and their team implanted 256 electrodes in the areas of the male brain responsible for facial muscle control necessary for speech. In subsequent sessions, they introduced thousands of sentences on a screen, recorded brain activity, and prompted the subject to vocalize with specific intonations.

“For instance, phrases like ‘How are you today?’ or variations such as ‘How are you? today?’ can significantly alter the meaning of sentences,” explains Stavisky. “This approach allows for a richer, more natural dialog, marking a significant advancement over previous technologies.”

The researchers utilized an AI model trained to link particular patterns of neural activity with corresponding words and tonal variations, resulting in synthetic speech that mirrors both the content and emotional delivery intended by the user.

The AI was trained with audio recordings from before the male’s condition deteriorated, employing voice-cloning technology to ensure the synthetic speech bore a resemblance to his original voice.

In another phase of the study, researchers attempted to teach him to sing a simple melody with varying pitches, with their models accurately interpreting the intended pitch in real time and adjusting the produced singing voice accordingly.

He also utilizes the system to communicate spontaneously, making sounds such as “hmmm,” “eww,” and forming words, as noted by Wairagkar.

“He’s a remarkably articulate and intelligent individual,” says David Brandman from UC Davis. “Despite his paralysis, he has continued to participate actively in work and engage in meaningful conversations.”

topic:

Source: www.newscientist.com

Study finds honeyguide birds have the ability to recognize distinct audio signals to assist humans in locating beehives

Greater Honey Guide (indicator indicator)It is a type of African bird. well known To attract other species to the hive. They have even been known to collaborate with ratels, but their closest and most successful collaborators are humans. Several indigenous groups in Africa work with these birds throughout their range. Observing these interactions in Tanzania and Mozambique, scientists showed that honey guides were more responsive to the specific calls of their local honey-hunting partners compared to the calls of honey hunters in other regions. Ta. Honey guides therefore appear to learn the calls of their local partners, and honey hunters maintain these successful calls for generations.

Spottiswood and Wood experimentally showed that honeyguides in Tanzania and Mozambique distinguish between the calls of honeyhunters and are more likely to respond to local calls than to foreign calls. Image credit: Brian Wood.

The animal kingdom is full of interactions between species, but systems in which humans can successfully cooperate with wild animals are rare.

One such relationship involves the greater honeyguide, a small African bird known for guiding humans to wild bee hives.

Humans open the hive to collect honey, and bees eat the exposed beeswax.

Human honey hunters in different parts of Africa may use specialized and culturally distinct calls to signal their search for a honey guide partner and to maintain cooperation while following guided birds. It happens often.

For example, the honey hunters of the Yao culture group in northern Mozambique use a loud trill followed by a grunt (“brrr-hm”).

In contrast, the Honey Hunters of the Hadza cultural group of northern Tanzania use melodic flutes.

These successful calls have been maintained in these groups for generations.

In a series of field experiments across these disciplines, Dr. Claire Spottiswood of the University of Cambridge and the University of Cape Town, and Dr. Brian Wood of the University of California, Los Angeles and the Max Planck Institute for Evolutionary Anthropology, found that the ecology of honeyguides is We investigated whether it is good or not. They tend to respond more to the signals of their local human culture than to signals from another culture or any human sounds.

The authors found that honeyguides in the Yao region were more than three times more likely to initiate an induced response to honeyguides. Yao’s unique cry than Hadza’s whistle.

Conversely, honey guides in the Hadza region were more than three times more likely to respond to Hadza whistles than to Yao bloom sounds.

“It’s such a privilege to witness the collaboration between people and honeyguides, especially the birds that come looking for us,” Dr Spottiswoode said.

“Their calls sound exactly like a conversation between a bird and a bee as they travel together towards the beehive.”

According to the authors, the geographic variation and coordination between signals and responses observed in this behavioral system suggests that cultural coevolution has occurred between honeyguides and humans.

“What’s remarkable about the relationship between honey guides and humans is that interactions with humans involve free-living wild animals that have probably evolved through hundreds of thousands of years of natural selection,” Dr. Spottiswood said.

“Through learning, this ancient and evolved behavior was refined to fit local cultural traditions, or different human calls.”

“Our research demonstrates the ability of this bird to learn unique vocal signals traditionally used by various honey-hunting communities, opening up possibilities for mutually beneficial cooperation with people.” ,” Dr. Wood said.

Regarding this research, paper in a diary science.

_____

Claire N. Spottiswood and Brian M. Wood. 2023. Culturally determined interspecies communication between humans and honey guides. science 382 (6675): 1155-1158; doi: 10.1126/science.adh4129

Source: www.sci.news

New research reveals the potential of using short audio recordings as a diagnostic tool for diabetes | Latest Findings in Science and Technology

New research has found that diabetes may be diagnosed with just a short audio recording from a mobile phone.

Scientists can determine whether someone has diabetes with nearly 90% accuracy using just a 6-10 second audio sample and basic health data such as age, gender, height, and weight I created an AI model.

Klick Labs recruited 267 people for the study, including some who had already been diagnosed with type 2 diabetes.

Each subject was asked to record a phrase on their phone six times a day for two weeks, and the team used AI to analyze more than 18,000 samples to determine the acoustic differences between diabetics and non-diabetics. I looked into it.

These included changes in pitch caused by type 2 diabetes that are imperceptible to the human ear.

This model had an accuracy rate of 89% for women and 86% for men.

Study author Jaycee Kaufman said the results could “change” the way we screen for diabetes.

More than 90% of adults with diabetes in the UK have type 2 diabetes, but many go undetected for years as symptoms may be systemic or absent. I am.

Testing for this disease usually requires a visit to a general practitioner and urine and blood tests.

“Current detection methods can be time-consuming, travel-intensive, and costly,” Kaufman said.

“Voice technology has the potential to completely remove these barriers.”

Read more science and technology news:
The rise and fall of BlackBerry
Debunking myths about the influenza vaccine
NASA reveals ‘unbelievable’ asteroid discovery

Previous research has shown that audio recordings can be used in conjunction with AI to diagnose other diseases. Including new coronavirus infection.

Klick Labs believes this technology can also diagnose conditions such as prediabetes and hypertension.

This peer-reviewed study was published in the Mayo Clinic Proceedings journal.

Source: news.sky.com