Slashdot Mirror
BrainPort Lets the Blind "See" With Their Tongues
Hugh Pickens writes "Scientific American reports that a new device called 'BrainPort' aims to restore the experience of vision for the blind and visually impaired by relying on the nerves on the tongue's surface to send light signals to the brain. BrainPort collects visual data through a small digital video camera and converts the signal into electrical pulses sent to the tongue via a 'lollipop' that sits directly on the tongue, where densely packed nerves receive the incoming electrical signals. White pixels yield a strong electrical pulse and the electrodes spatially correlate with the pixels, so that if the camera detects light fixtures in the middle of a dark hallway, electrical stimulations will occur along the center of the tongue. Within 15 minutes of using the device, blind people can begin interpreting spatial information. 'At first, I was amazed at what the device could do,' says research director William Seiple. 'One guy started to cry when he saw his first letter.'" There is some indication that the signals from the tongue are processed by the visual cortex. The company developing the BrainPort will submit it to the FDA for approval later this month, and it could be on sale (for around $10,000) by the end of the year.
Oooh hello pretty lady, come on over here and let me get a good lick at you.
Fascism trolls keeping me up every night. When I starts a preachin', he HITS ME WITH HIS REICH!
"Taste the rainbow" was the first thing that came to mind when I read this.
I'm pretty sure I read about this exact thing years ago. Weren't there issues with the tongue being "low resolution" and interfering with eating and talking?
The human brain is adept at processing pattern streams. These are two-dimensional datasets that change over regular intervals of time. In the specific case of this tongue-sight project, they are taking advantage of the ability of the tongue to transmit many "pixels" of sensory information in a square grid. Which pins poked into the tongue governed what the brain got that instant of time. So, by reading the changing pattern of the dots, the brain can learn to process that pattern stream in the same way it learns to process the pattern stream that is the million or so "pixels" of information each eye sends, each unit of time. The left brain hemisphere processes Linear-Sequential Information. The right brain hemisphere processes Visual-Simultaneous Information. We know that from the Nobel-prize-winning [1980] research of Dr. Roger Sperry. Current computers process information in a linear, sequential fashion--much like the left hemisphere works. The true breakthroughs in AI will come when we can process and interpret the pattern streams that reach the right hemisphere, the image-oriented streams. The complex interplay between the faster linear-sequential hemisphere and the holistic visual-simultaneous hemisphere is what creates consciousness. This tongue-stream is a great idea.
It tastes like oranges.
Sure, the resolution won't be as fine but it will be a lot less obtrusive to wear a sensor wrapped around your torso than to have something on your tongue with a wire sticking out of your mouth.
A practical version of that sensor net the blind lady wore on Star Trek back in the '60s will likely be on the market before 2067, assuming technology doesn't leapfrog it entirely.
From TFA:
The key to the device may be its utilization of the tongue, which seems to be an ideal organ for sensing electrical current. Saliva there functions as a good conductor, Seiple said. Also it might help that the tongue's nerve fibers are densely packaged and that these fibers are closer to the tongue's surface relative to other touch organs. (The surfaces of fingers, for example, are covered with a layer of dead cells called stratum corneum.)
My page.
About 20 years ago I thought of a device for deaf people to "see sound" after reading that researchers have learned to read spoken words from from gray-scale sound spectrograms (frequency plots).
Now an off-the-shelf PDA or iPhone could probably do the trick of showing a plot with the right software. Some slashdot readers claimed it's too hard to learn if you never heard sound before. But it may be worth a try. Besides, some deaf people used to hear before an injury or illness. It's basically pattern-recognition, something humans are pretty good at given sufficient feedback.
Perhaps these devices can be combined and the frequency plots could flow through the tongue. However, I suspect there's insufficient resolution that way, and eyeballing it would be better. But, it's worth a try.
Table-ized A.I.
A whole load of links done with the Google site:slashdot.org search modifier
Slashdot 2006
PBS 2007
Slashdot 2008
Sensory substitution
Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
You can read all about the work leading up to this device, why it works, amazing stories of recovery from brain injury, and other cool stuff in a book called The Brain That Changes Itself.
This is one of the best books I've ever read.
In the course of every project, it will become necessary to shoot the scientists and begin production.