Slashdot Mirror
How Seeing Can Trump Listening, Mapped In the Brain
cortex writes "University of Utah bioengineers discovered our understanding of language may depend more heavily on vision than previously thought: under the right conditions, what you see can override what you hear. In an article published in PLOS One, 'Seeing Is Believing: Neural Representations of Visual Stimuli in Human Auditory Cortex Correlate with Illusory Auditory Perceptions,' the authors showed that visual stimuli can influence neural signals in the auditory processing part of the brain and change what a person hears. In this study patients were shown videos of an auditory illusion called the McGurk Effect while electrical recordings were made from the surface of the cerebral cortex."
How can he physically produce the "Baa" sound when his bottom lip is tucked behind his teeth? His lips don't press together when the illusion is supposed to make it sound like he's saying "Faa" instead. I think he's actually making two different sounds.
Isn't the "Baa" sound impossible to make without the lips pressing together? Isn't the "Faa" sound impossible to make without blowing on the lip-teeth connection with the top and bottom lips separate?
This is the perfect description of what your brain is doing. Unfortunately, it appears you're misunderstanding what is actually going on. There is only one audio recording. It is dubbed over both clips. Check the section where there is a side by side with both videos. What you hear depends on what side of the screen you look at, even though there is only one audio track.