Slashdot Mirror
How Seeing Can Trump Listening, Mapped In the Brain
cortex writes "University of Utah bioengineers discovered our understanding of language may depend more heavily on vision than previously thought: under the right conditions, what you see can override what you hear. In an article published in PLOS One, 'Seeing Is Believing: Neural Representations of Visual Stimuli in Human Auditory Cortex Correlate with Illusory Auditory Perceptions,' the authors showed that visual stimuli can influence neural signals in the auditory processing part of the brain and change what a person hears. In this study patients were shown videos of an auditory illusion called the McGurk Effect while electrical recordings were made from the surface of the cerebral cortex."
Ever happen to be looking for a street in an unknown area, and you end up turning down your radio? This actually increases your visual acuity slightly even though many may question your sanity when doing it. Many blind people have increased auditory capacity, and this has been known for a very long time. It doesn't seem all that far fetched that one (or more) of those senses could override the other. Maybe that meal that you hate tastes absolutely amazing...but looks so terrible that you taste it differently.
How can he physically produce the "Baa" sound when his bottom lip is tucked behind his teeth? His lips don't press together when the illusion is supposed to make it sound like he's saying "Faa" instead. I think he's actually making two different sounds.
Isn't the "Baa" sound impossible to make without the lips pressing together? Isn't the "Faa" sound impossible to make without blowing on the lip-teeth connection with the top and bottom lips separate?
This is the perfect description of what your brain is doing. Unfortunately, it appears you're misunderstanding what is actually going on. There is only one audio recording. It is dubbed over both clips. Check the section where there is a side by side with both videos. What you hear depends on what side of the screen you look at, even though there is only one audio track.