Slashdot Mirror
BrainPort Lets the Blind "See" With Their Tongues
Hugh Pickens writes "Scientific American reports that a new device called 'BrainPort' aims to restore the experience of vision for the blind and visually impaired by relying on the nerves on the tongue's surface to send light signals to the brain. BrainPort collects visual data through a small digital video camera and converts the signal into electrical pulses sent to the tongue via a 'lollipop' that sits directly on the tongue, where densely packed nerves receive the incoming electrical signals. White pixels yield a strong electrical pulse and the electrodes spatially correlate with the pixels, so that if the camera detects light fixtures in the middle of a dark hallway, electrical stimulations will occur along the center of the tongue. Within 15 minutes of using the device, blind people can begin interpreting spatial information. 'At first, I was amazed at what the device could do,' says research director William Seiple. 'One guy started to cry when he saw his first letter.'" There is some indication that the signals from the tongue are processed by the visual cortex. The company developing the BrainPort will submit it to the FDA for approval later this month, and it could be on sale (for around $10,000) by the end of the year.
Oooh hello pretty lady, come on over here and let me get a good lick at you.
Fascism trolls keeping me up every night. When I starts a preachin', he HITS ME WITH HIS REICH!
"Taste the rainbow" was the first thing that came to mind when I read this.
Does that mean ugly girls "taste like shit"?
I'm pretty sure I read about this exact thing years ago. Weren't there issues with the tongue being "low resolution" and interfering with eating and talking?
The human brain is adept at processing pattern streams. These are two-dimensional datasets that change over regular intervals of time. In the specific case of this tongue-sight project, they are taking advantage of the ability of the tongue to transmit many "pixels" of sensory information in a square grid. Which pins poked into the tongue governed what the brain got that instant of time. So, by reading the changing pattern of the dots, the brain can learn to process that pattern stream in the same way it learns to process the pattern stream that is the million or so "pixels" of information each eye sends, each unit of time. The left brain hemisphere processes Linear-Sequential Information. The right brain hemisphere processes Visual-Simultaneous Information. We know that from the Nobel-prize-winning [1980] research of Dr. Roger Sperry. Current computers process information in a linear, sequential fashion--much like the left hemisphere works. The true breakthroughs in AI will come when we can process and interpret the pattern streams that reach the right hemisphere, the image-oriented streams. The complex interplay between the faster linear-sequential hemisphere and the holistic visual-simultaneous hemisphere is what creates consciousness. This tongue-stream is a great idea.
So what does blue taste like?
Sure, the resolution won't be as fine but it will be a lot less obtrusive to wear a sensor wrapped around your torso than to have something on your tongue with a wire sticking out of your mouth.
A practical version of that sensor net the blind lady wore on Star Trek back in the '60s will likely be on the market before 2067, assuming technology doesn't leapfrog it entirely.
Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
About 20 years ago I thought of a device for deaf people to "see sound" after reading that researchers have learned to read spoken words from from gray-scale sound spectrograms (frequency plots).
Now an off-the-shelf PDA or iPhone could probably do the trick of showing a plot with the right software. Some slashdot readers claimed it's too hard to learn if you never heard sound before. But it may be worth a try. Besides, some deaf people used to hear before an injury or illness. It's basically pattern-recognition, something humans are pretty good at given sufficient feedback.
Perhaps these devices can be combined and the frequency plots could flow through the tongue. However, I suspect there's insufficient resolution that way, and eyeballing it would be better. But, it's worth a try.
Table-ized A.I.
The hardware seems like a fairly pedestrian evolution of cheap image sensors and high-density fabrication techniques.
The fact that the brain will, fairly swiftly, being interpreting electrical pulses on the tongue as visual input blows my insufficiently capacious mind.
Who'll be the first to choke to death on Goatse?
Table-ized A.I.
A whole load of links done with the Google site:slashdot.org search modifier
Slashdot 2006
PBS 2007
Slashdot 2008
Sensory substitution
Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
I don't have the link ready to hand, but the technology behind this was posted to slashdot quiet a while ago. (At least many months, possibly over a year ago) Anyway, I was wondering when we would hear about this technology again, since it has tremendous potential both for sight-restoration applications, as well as furthur development towards the integration of machine and brains. If the resolution was high enough, for instance, a pilot could use this to see underneath the plane, or in other directions normally blocked. The potential application for guided search and rescue, and other remote controlled devices is also large. "being" there is better than simply seeing on a screen, after all, even if virtually. I hope that the various gov't and none-profit groups that support the visually impaired take note of this as a way to help people become active and contributing parts of society again. It's nice to take care of the impaired, but better to help them regain their independence.
Z
You can read all about the work leading up to this device, why it works, amazing stories of recovery from brain injury, and other cool stuff in a book called The Brain That Changes Itself.
This is one of the best books I've ever read.
In the course of every project, it will become necessary to shoot the scientists and begin production.
What happens when you burn your tongue? Does your "sight" degrade or get blurry while your taste buds are being repaired?
Fry: Did everything just taste purple for a second?
Tactile reaction time is faster than visual reaction time. If the resolution is high enough and the switching time fast enough, could this system be advantageous where fast reactions are needed (eg. games, sport, driving, combat, etc.). Could it be combined with normal vision for a kind of minor precognition?
How about using it for extended vision with more frequency channels, wider or narrower field of vision, faster automatic brightness control, etc? Touch has multiple channels but how many are high enough resolution to be useful?
As anyone who's used psychedelic drugs will know, the human visual system is bottlenecked by the eyes. The brain can certainly handle more powerful sensors so we should be working on making them.
I'd love to be able to see tastes - that is, have my sense of taste piped to the brain as vision instead of taste. I wouldn't want my vision permanently replaced, but I'd love to experience the brain visualising what I taste. And hey, instead of the usual 3 dimensions (or more if you're lucky), you'd have 5 factors to go with.
Older than that. From September 1, 2001:
http://www.thefreelibrary.com/The+Seeing+Tongue-a078681631