Slashdot Mirror


Hacking Our Five Senses

zdude255 writes "Wired is running an article exploring several studies of giving the human brain 'new input devices.' From seeing with your sense of touch to entirely new senses such as sensing direction intuitively, the human brain seems to be capable of interpreting and using new data on the fly. This offers many applications from pilots being able to sense the plane's orientation to the potential recovery of patients with blindness or ear damage. (which helps balance).'It turns out that the tricky bit isn't the sensing. The world is full of gadgets that detect things humans cannot. The hard part is processing the input. Neuroscientists don't know enough about how the brain interprets data. The science of plugging things directly into the brain -- artificial retinas or cochlear implants -- remains primitive. So here's the solution: Figure out how to change the sensory data you want -- the electromagnetic fields, the ultrasound, the infrared -- into something that the human brain is already wired to accept, like touch or sight.'"

41 of 232 comments (clear)

  1. I am not so sure I would want by willie_nelsons_pigta · · Score: 3, Funny

    I am not so sure I would want other parts of my body seeing. A finger in my nose may not be the most pleasant thing to look at.

    1. Re:I am not so sure I would want by goombah99 · · Score: 2, Funny

      You think that's bad, wait till they start messing with the output devices. But don't worry the finger in the nose. it's suppose to go there (thats why it fits) and thus your nose was rewired too be the download port for your finger camera. it's only 100MBs/sec though so if you have a lot of images you need to use the firewire port located in the rear.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    2. Re:I am not so sure I would want by Anonymous Coward · · Score: 2, Funny

      Wrong. Firewire isn't in the rear. The rear is a grounded power outlet, as demonstrated by the one 'Bender'.

      Down front? Yeah, that's the stylus. It improves productivity by enticing at least 50% of the workforce to use it often and requires no additional training. The developers thought of outfitting it with a laser, but were afraid of it blinding attendants during so-called money shots.

    3. Re:I am not so sure I would want by SatanicPuppy · · Score: 5, Interesting

      It's not so much that...One of the one's I found most interesting in the series was a kind of belt device that vibrated constantly on the side that faced magnetic north...Like having a dozen cellphones strapped to your belt, where whichever one is on the north side of your body vibrates.

      A guy wore it for a year, iirc, and his body adapted to the new "sense" to such a degree that he had a little freak out break down when he removed it, and now walks around with a handheld gps all the time, to try and make up for the "sense" of direction he lost. He says he developed a kind of spacial sense, which gave him a firm sense of spacial orientation...he stopped getting lost...and just sort of knew little directional tidbits like "my house is in that direction" etc.

      One of the most interesting things about the articles, is the thread that all our senses are capable of processing more data than we give them credit for...Another article talked about a limited visual sense that interfaced through the tongue, and worked almost without any training at all.

      It's some cool stuff, and it definitely opens up some possibility for some interesting sensory "prosthesis" to give information that isn't processed by our natural senses.

      --
      ad logicam Claiming a proposition is false because it was presented as the conclusion of a fallacious argument.
    4. Re:I am not so sure I would want by Lumpy · · Score: 4, Interesting

      It's not new in any way. Prof. Steve Mann from the U of Toronto has been a "cyborg" for over 10 years now. His research into wearable computing has gone way past what these guys are talking about. not log ago he removed his gear and had a complete breakdown. Not having hid database and other sensory enhancements he had built in and became reliant on has a big drawback from what he discovered in his research.

      Your body adapts fast to new supplimentary input (Nicotene for example) and does not want to give it up after it has gone.

      I strongly reading his research papers for anyne interested in this technology and subject.

      --
      Do not look at laser with remaining good eye.
    5. Re:I am not so sure I would want by TheCarp · · Score: 3, Interesting

      I found this interesting in a recent show I saw called "Addiction"

      They did FMRI scans of people in various situations, some addicts, some not.

      What they showed was actual differences in their brain activity in various centers... changes that happened slowly over time. Use the drug over and over, and your brain adapts to that input, it changes in response to it.

      Of course this is assumed to be an unequivicolly bad thing, though, I am not sure we really can put a value judgement on it... its one of those "it is what it is" things, we still don't know quite what to make of it... its still very very high level.

      Of course, we should expect this with all things. I was born epileptic. I spent the first half of my life (up to this point) on anti-seizure drugs like tegratol. Look at what tegratol does, imagine a brain being exposed to it on a daily basis during its most formative years.... wow.

      There has been only very very limited study into the area. I found a few articles in some recent searches on the subject. Some evidence that kids who grow up on these meds have lower incidence of marriage, lower overall achievement, etc. Overall, from my interactions with others, I have come to realise... my brain works differently in ways that actually makes it really hard to relate to alot of people in some ways.

      How much of that is genetics? how much of that is upbringing? How much of that is changes made over years by exposure to brain fucntion altering drugs? How much of my formative experiences were colored or directly influenced?

      Don't get me wrong... I am not trying to make a value judgement here, or say "hey look, they broke me" just that, more fascination with how the brain works and how changeable it really is. I would love to have such a "space belt". I wonder wat FMRIs of people who wore one for a year or two would differ from others.

      This stuff just fascinates me.

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    6. Re:I am not so sure I would want by lhand · · Score: 2, Insightful

      My first thought too.

      It seems, though, that they are looking for interfaces that bypass the cogintive functions and feed data directly to what we'd call feeling. Where a compass will only show you which way is north if you look at and find where the needle is pointing, the belt gives a constant throb in the nortern direction that does not require conscious thought.

      There was a story a while back about people getting magnets (those super-strong rare earth ones) embedded under their finger tips. It gave them an ability to feel magnetic fields from sources such as power lines. This gave them an awareness of the fields at all times. It started to change the way they saw the world when they could feel the constant effects of the electricty flowing around them.

    7. Re:I am not so sure I would want by metlin · · Score: 2, Interesting

      Or Thad Starner.

      I went to GT, and even took a class of his. You could always see him walking around with all kinds of things attached to him. Some of his PhD students are the same way, too. Although, the continuous clicking and buzzing does get to you after a while.

      Both Starner and Mann have done some very pioneering work in this area.

      Although, to be fair, Mann has done significantly more and has been at this a lot longer. IIRC, he was once stopped at an American airport for carrying this stuff. They refused to believe that he was dependent on them (he's Canadian). I remember a talk by him where he said that he now drove, instead.

    8. Re:I am not so sure I would want by Have+Brain+Will+Rent · · Score: 2, Interesting

      There is a very interesting little book about this sort of thing called "The Tacit Dimension" written by Polanyi, a philosopher interested in epistemology.

      --
      The tyrant will always find a pretext for his tyranny - Aesop
  2. Related by UbuntuDupe · · Score: 4, Interesting

    "Sense-hacking" seems like a very fun, interesting pursuit. I recently learned that humans can be trained to echolocate. Wiki article. That looks like a historical example of what they're trying to do -- get the hearing inputs tuned so that you can "sense" the location of nearby objects because your brain transforms that echo into location data.

    1. Re:Related by MyDixieWrecked · · Score: 3, Interesting

      That reminds me of an article I submitted to slashdot a few years back. A guy had implanted magnets in his fingertips and he could use that to sense other magnets and metallic objects. He said that he was surprised when he was able to detect where the motor was inside an electric can-opener just by putting his fingers close to it.

      It seemed like a really interesting concept. Similar to how your sense of direction works by using magnetic north.

      This also reminds me of an element of this book I just read (Rant by Chuck Palahniuk). In the future, people have ports that enable them to plug in and experience a recorded neural episode. In the story, you could get a large-breasted girl high on heroin and sit her in a train watching the scenery go by, the whole time playing with herself and output that to a new recording that you could rent and experience yourself without the dangers of actually doing heroin.

      It was quite an amazing concept.

      --



      ...spike
      Ewwwwww, coconut...
  3. mmmmm by spooje · · Score: 2, Funny

    So what does blue taste like?

    --
    Tea and kung-fu. Life is good. Rising Phoenix
    1. Re:mmmmm by Gwala · · Score: 4, Funny

      Chicken.

      --
      #!/bin/csh cat $0
    2. Re:mmmmm by CastrTroy · · Score: 2, Informative

      Are you trying to be funny, or are you talking about Synesthesia

      --

      Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
  4. See taste by networkBoy · · Score: 4, Interesting

    There was a short blurb in Science News a couple months back about how an electrode array when placed on the tongue gave the participants a sense of sight. The electrode used the tongue to send impulses similar enough to visual signals for volunteers to discern a 3x3 matrix of on/off dots. Pretty cool stuff, though I'd pay dearly for infravision and/or ultrasound augmentation.
    -nB

    --
    whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
  5. Remember the experiment? by $RANDOMLUSER · · Score: 5, Interesting

    There was an experiment where people wore goggles that made everything upside-down and reversed left-to-right. After about 6 weeks (IIRC) wearing them, suddenly the test subjects woke up one morning and could see everything normally. When the goggles were then removed, they saw everything upside-down and reversed for another 6 weeks. So changing the brains sensory processing is definitely possible.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    1. Re:Remember the experiment? by symes · · Score: 3, Informative

      That would be Steve Mann. AFAIK - he once wired up a radar to assist his bike rides.

    2. Re:Remember the experiment? by mykdavies · · Score: 5, Informative

      http://www.madsci.org/posts/archives/mar97/8589845 31.Ns.r.html

      "The upside-down glasses that you describe were first investigated by George Stratton in the 1890s. Since the image that the retina of our eye sees is inverted, he wanted to explore the effect of presenting the retina an upright image. He reported several experiments with a lens system that inverted images both vertically and horizontally. He initially wore the glasses over both eyes but found it too stressful, so he decided to wear a special reversing telescope over one eye and keep the other one covered.

      "In his first experiment, he wore the reversing telescope for twenty-one hours. However, his world only occasionally looked normal so he ran another experiment where he wore it for eight days in a row. On the fourth day, things seemed to be upright rather than inverted. On the fifth day, he was able to walk around his house fairly normally but he found that if he looked at objects very carefully, they again seemed to be inverted. On the whole, Stratton reported that his environment never really felt normal especially his body parts, although it was difficult to describe exactly how he felt. He also found that after removing the reversing lenses, it took several hours for his vision to return to normal."

      The link has references to the source material.

      --
      The world has changed and we all have become metal men.
  6. B0Rg Country by Finger$lut · · Score: 2, Funny

    With integrated GPS we would always know where we are and where to go. We could use an AI integrated with our accumulated knowledge to be that "voice in our head" with all of the right answers. We could use our own wifi to be an ad hoc network to communicate, plan and execute with unity. We can't stop here, this is B0rg country.

  7. Not very new... by LBArrettAnderson · · Score: 4, Insightful

    So here's the solution: Figure out how to change the sensory data you want -- the electromagnetic fields, the ultrasound, the infrared -- into something that the human brain is already wired to accept, like touch or sight.

    That's something that's been done for a long time... a radio transfers radio waves into something that we can hear. A clock transfers the current time to something we can see. A compass also shows us direction in a way that we can see. That's what instruments do. This would be better news if it talked about how the scientists are putting it directly into our brains, as opposed to how that's NOT what they're doing; they've been doing this stuff for many thousands of years already.

    1. Re:Not very new... by Rob+T+Firefly · · Score: 2, Informative

      Agreed. The only novelty about the methods in TFA seems to be that they are translating data to tactile rather than visual information, but when it all comes down to it this doesn't seem much more "hacking the five senses" than a pocket compass translating physical orientation into visual data.

    2. Re:Not very new... by stonecypher · · Score: 2, Insightful

      What these scientists are doing isn't providing a filter before the biological input device. They're creating new input devices that can use the biological input devices' connection points. As you'll note, if you rfta, the scientists are in fact talking about their apparent inability to junction directly to the brain, due to not knowing how the brain speaks.

      Yes, we're aware that when the article talks about things we've done in the past, that they're not new. Please don't complain about the last few sentences in the story as if they're the only thing that got said.

      --
      StoneCypher is Full of BS
    3. Re:Not very new... by 2short · · Score: 2, Insightful

      I disagree. Being constantly, sub-conciously aware of what direction you're facing is different in interesting ways from having a compass in your pocket you can check when you think of it.

      I've lived in and learned my way around several metropolitan areas. I acquired a far better geographic understanding, far faster, in the Denver area than any of the others. I think this is because anywhere in the Denver area, whether you are thinking about it or not, you are aware of your position relative to the same landmarks (the Rocky Mountains). I don't think carrying a compass, or even a GPS, in ones pocket to be looked at when you thought of it would be at all comparable.

  8. wired by symes · · Score: 2, Interesting
    While the idea of boosting our sensory abilities is appealing I'm not sure that it is something that I would like to play with. The brain is malleable and can rewire itself as it learns (plasticity). This happens most obviously when we learn... and a great example is that the a London taxi driver's hippocampus is significantly larger than non-taxi-driving controls. The hippocampus helps process spatial information, hence the increased size in taxi drivers.

    But these changes through experience are fairly permanent and coupled with the brains finite computational power this would mean devoting brain resources to specific extra-sensory processing. This, firstly, takes processing power from existing processes and, secondly, means any upgrades would need to be relearnt over time. In other words, by the time you've learnt how to use smelly-vision(tm) version 1, version 2 will be released and you'll have to start the whole learning thing all over again.

  9. Eek by goldaryn · · Score: 3, Funny

    "Wired is running an article exploring several studies of giving the human brain 'new input devices.'

    Get ready for plug-and-pray, mark 2..

  10. Lecture on Feelspace by teslar · · Score: 2, Informative

    One of the things mentioned in TFA is König's feelSpace belt, a belt which gives you information about which direction North is. A lecture he gave about it at the Neuro IT summer school in 2005 is actually available here. It's from two years ago, granted, but still reasonably interesting.

  11. There's less here than meets the eye by dpbsmith · · Score: 2, Interesting

    I don't see how this is fundamentally different from a 1950's family physician looking a fluoroscope and "seeing" with X-rays. Or, for that matter, an ordinary set of car rear-view and side mirrors, which give us "eyes in the back of our heads." Or a neurophysiologist connecting his electrodes to an amplifier and speaker, as well as watching an oscilloscope trace.

    This sort of sensory augmentation is hardly a new idea.

    The thing I want to know is: is there any way to increase the bandwidth with which the brain can process incoming information? I seriously doubt it.

    It seems to be increasingly evident that a cell phone that makes no use of ones' hands nevertheless consumes attention that would otherwise be allocated to driving, and I suspect this is true of every other input modality.

    Attentionis a limited resource. You might as well present the information on an ordinary viewing screen that occupies part of the field of view. However you present it, you can't add more information without blocking your "view" of information you'd otherwise be processing.

  12. Just plug it in by blamanj · · Score: 2, Informative

    Recent experiments that have given mice new color-sensing ability seems to imply that if you can just get the input into the brain, the brain will try and incorporate it. Obviously, this works best when the brain is still "plastic", when the organism is young. I wonder if you wired an infrared camera (or similar) to a newborn that by the time they were a couple of years old, they'd be making full use of the additional information.

    Unlike the Neuromancer fantasy, you can't just jack in, but if implanted early enough, you could adapt to the additional sensory input.

  13. Interesting topic, badly written. by alexhs · · Score: 4, Informative

    First, this is not exactly new. For example, I've read years ago about an equipment with a camera and a dot-matrix that could be put on the finger of a blind person, so that person could see in a low-resolution.

    What's interesting is that it can also apply to add sense we might not have in the first place.

    Now the writer doesn't understand much about senses :(
    There are more than five, and he even cites internal ear. The balance sense is a full sense, while proprioception is a mix of senses : mainly balance sense, touch (wind orientation changing, heat from the sun), vision (even eyes closed you might be able to see a little light from the sun), sources of sound rotating...

    Also, other classic senses are also mixes :

    Touch is composed from (at least) pression sensing, heat sensing.
    Taste is all what composes touch (feeling of the texture of what you eat, heat) plus tongue receptors,
    plus flavours receptors, closely related to smell.

    Pain is a separated sense, it's a stress from cell that then emit strong signals in nerves and can originate from internal organs.

    --
    I have discovered a truly marvelous proof of killer sig, which this margin is too narrow to contain.
  14. Driver crash! by NotQuiteReal · · Score: 2, Funny

    Would you like the large dump or the small dump? Where do you want to save it?

    --
    This issue is a bit more complicated than you think.
  15. The human brain by vivin · · Score: 4, Informative

    The human brain is pretty plastic. It can adapt to a lot of new conditions. In patients who are recently blind, or even in people who have been blindfolded for a while, the sense of touch and sound is amplified. Areas of the brain that were used for vision, are now used to interpret sound and touch. PET shows which parts of the brain are active. Check out Phantoms in the Brain and .

    --
    Vivin Suresh Paliath
    http://vivin.net

    I like
  16. Seriously, not such a bad idea. by Kadin2048 · · Score: 2, Interesting

    You're joking, but I could see some applications of this in cars.

    For example, right now there are a lot of cars with sonar sensors to aid in back-in parking. Rather than turning that into audible output that requires a lot of processing to make sense of ("three feet ... two feet ... " or even "beep...beep..beep..beepbeepbeeeep") you could wire it to an output device that uses some of the driver's unused senses.

    Many cars also have inflatable air bladders located in the back of the driver's seat, for lumbar support. Imagine if we connected the parking sensor to the lumbar support, so that as you backed the car in, you'd feel pressure against your back as you got closer and closer to the obstacle. (You'd still want an alarm when you got too close, something that triggered the brain's "abrupt onset" threat response.)

    A more complicated system might use multiple bladders, one in the center of the back and smaller ones on either side, to let the driver know approximately how close they are to the car in back, and to the curb, when parallel parking.

    Such a system would probably require minimal training and be quick to subliminalize, because it's pretty close to what we experience naturally. (If you're carrying a heavy box and walking backwards, and you feel something contact your back or the back of your legs, even lightly, you're going to immediately stop moving.)

    I hope that this research leads to new kinds of output devices that use more of the brain than today's systems, which tend to present everything as predominantly visual, with a smattering of auditory, data.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  17. Wouldn't that be just as 'bad' as the real thing? by Kadin2048 · · Score: 4, Interesting

    I haven't read the book, but it seems like if you were to play back a "recording" of someone ingesting a psychoactive drug, and the recording was being piped directly into your brain in such a way that it was perceived as real, wouldn't that be just as physiologically addictive as the actual drug?

    I mean, heroin works because it causes certain chemicals inside the brain to change. If you don't release those chemicals, it's not going to feel the same. So a completely honest recording of a heroin trip would necessarily have to produce the same physiological response in your synapses as the real thing.

    I suspect, that if such a technology were available, that "recordings" of people doing drugs would quickly become just as illicit as the drugs themselves, because they'd be just as addictive. (Although, it's not as though the drug laws in the U.S. have ever had any real correlation to harm, so it might matter more who was making money by selling said recordings and how many Senators they owned.) There are quite a few novels that I've read where the idea of addictive neuro-stimulus was discussed; off the top of my head I think it comes up in Neuromancer, Snow Crash, and the Otherland series by Tad Williams.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  18. It's Called A "Wife" by rewinn · · Score: 4, Funny

    When I got married, my sense of hearing adapted to enhance my sense of color ("You're going to wear that?"), smell ("The garbage needs taking out") and self-preservation ("Does this make me look fat?")

  19. Imagine you had a sense that nobody else had by hey! · · Score: 4, Interesting

    Would you even know you had it, not being able to describe it to other people?

    It turns out there are other senses, other than the five Aristotelean ones. Proprioception, for one: the awareness of body positioning. People who have proprioceptive disorders because of things like brain damage don't really have convenient and commonly understood language to describe their impairment to other people, other than to say they have brain damage that makes them clumsy.

    But language or not, at least people share the sense of proprioception, so there are shared experiences that could form the basis for communication. But imagine you had some ability most other people didn't have, say the ability to detect electric current or to feel when somebody was observing you. I'm not sure you would necessarily even be aware when the sense was operating, other than feeling a kind of "intuition".

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  20. Re:sure be nice to see electric fields by maxwell+demon · · Score: 2, Informative

    You already can see electric fields. Provided they oscillate at 400 to 750 THz.

    --
    The Tao of math: The numbers you can count are not the real numbers.
  21. "Five" senses? by Rogerborg · · Score: 2, Insightful

    Stand up and close your eyes. What's stopping you from falling over? Touch your nose. Wow! You must have ESP or something!

    --
    If you were blocking sigs, you wouldn't have to read this.
  22. That's the "glass half empty." by Kadin2048 · · Score: 2, Insightful

    My car doesn't have such a system, so I don't know how helpful they are or aren't.

    However, having been once nearly driven over by a garbage truck whose operator didn't bother to use the rear-facing camera that was provided so that he could see what's in back of him, I think there's definitely a market for systems that deliver information in a more subtle manner, if that means that people pay more attention to the information that's provided.

    It's not just "bad drivers" that this sort of thing helps. If you had systems like this uniformly installed in all vehicles, it would make it much easier to go from driving one car to another. I don't generally let people unfamiliar with my car parallel-park it, because I don't want them to misjudge the corner and scrub my tires or scrape the wheels against the curb. Likewise, I probably wouldn't hop in a big sedan and try to do anything remotely challenging either, because it's been years since I've driven anything that large. But if you had a standardized system in vehicles to communicate to the driver the vehicle's position relative to any nearby obstacles (in the same way we have de facto standardized controls for steering, acceleration, brake, etc.), going from a VW Golf to an C-350 cargo van wouldn't be so much of a challenge. People would step out of one car and into another without a second thought.

    Rather than just looking at new technologies as opportunities for laziness (which they certainly can be), it's more helpful to focus on the new scenarios or activities that they make possible for people of average to moderate skill. An analogy with planes might be someone saying that AInstrument Landing Systems are just for pilots who don't know how to land properly. (I don't know the full story on their introduction but I'll bet you a shiny penny that some old pilots, somewhere, probably said just that.) While that's one way of looking at the technology, another way is to consider the number of places where planes can now land, where they'd otherwise have to be diverted due to poor weather conditions, darkness, etc.

    Automotive drivers' aids are the same way. While they will probably be used by some drivers who aren't up to snuff, in order to let them get away with things that they shouldn't, they can also allow good drivers to do things that they just accept as impossible or very difficult today.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
    1. Re:That's the "glass half empty." by Gilmoure · · Score: 2, Interesting

      I'm still amazed how I can know the external dimensions of my car ('70 Impala, 18' long) and manage to swing into parking spots without hitting anything. Somehow, people can visualize the spatial data and manage this. Wonder how we evolved this trait? From knowing how to hit animals with spears and sticks?

      --
      I drank what? -- Socrates
  23. Why yes! by Any+Web+Loco · · Score: 2, Funny

    I believe they even mention this study in TFA!

  24. Re:Sense of Smell and the cold by dissy · · Score: 3, Interesting

    Can most people detect when they're getting a cold? I always notice, just before the cold symptoms begin, a distinct baseline smell in my nose which does not come from the environment around me--it's always there no matter where I am or what I'm smelling.

    It's very strange you mention this. I have the same ability, which most people I tell about it claim is 'in my head'.

    The strangest part, in a botched medical procedure when I was 3 years old, I fully lost my sense of smell (Called 'anosmia'.)

    Yet to this day, about 12-18 hrs before I notice the first symptoms of a cold or flu, I too can smell this strange odor and know to associate it with having caught a cold.

    Unfortunatly due to not having a sense of smell, I've never been able to compare the cold catching smell with any other odor, but both due to the fact my smell receptors are physically damaged, and no one else i've mentioned this to knows what i'm talking about (plus you are the first person i've ever heard describe also having it), I tend to think either most people don't have this sense, or if they do it's percieved on such a low level that it's not realized it's even a sense or 'smell' and gets processed in another way by the brain.