Slashdot Mirror


Brain Implants Can Detect What Patients Hear

kkleiner writes "A group of 15 patients suffering from either epileptic seizures or brain tumors volunteered to allow scientists to insert electrodes into their brains. After neurosurgeons cut a hole in their skulls, the research team placed 256 electrodes over the part of the brain that processes auditory signals called the temporal lobe. The scientists then played words, one at a time, to the patients while recording brain activity in the temporal lobe. A computer was able to reconstruct the original word 80 to 90 percent of the time."

48 of 75 comments (clear)

  1. Brave New World by Foxhoundz · · Score: 3

    We need more articles like this. It's an encouraging progress in neuroscience.

  2. I see big potential here by GodfatherofSoul · · Score: 4, Funny

    My dreams of a womanspeak translator implant are on the horizon. Now, if they can just develop the technology to translate "Leave me the fuck alone until the game is over." into a more palatable sentence...

    --
    I swear to God...I swear to God! That is NOT how you treat your human!
    1. Re:I see big potential here by Anonymous Coward · · Score: 1

      "Leave me the fuck alone until the game is over."

      That's what I tell my girlfriend during our weekly Pathfinder game!

      Then she kills my character, 'cause she's the GM. :-(

    2. Re:I see big potential here by dreamchaser · · Score: 2, Funny

      Hunny, if you wish to talk to me about X during the game, I'll be more then happy to talk to you Y when is on.

      There you go...

      You obviously haven't studied enough Chaos Theory to think womanspeak breaks down into anything logical.

    3. Re:I see big potential here by mug+funky · · Score: 1

      dude, you're meant to be doing man things, like reaching high objects, changing tyres, and opening stuck jar lids.

    4. Re:I see big potential here by Saintwolf · · Score: 1

      Hunny, if you wish to talk to me about X during the game, I'll be more then happy to talk to you Y when is on.

      There you go...

      You obviously haven't studied enough Chaos Theory to think womanspeak breaks down into anything logical.

      He sounds fairly illogical to me, but that could just be the bad syntax on his part.

  3. Tech Support by swsuehr · · Score: 4, Insightful

    Earlier in my career when I had to do level 1 tech support I might have liked opportunity to cut holes in skulls to make sure people heard what was being said. However, *hearing* what's being said and actually processing that into meaningful and actionable instructions are two different things.

    1. Re:Tech Support by c0lo · · Score: 1

      Sometimes this thought scares me. It makes me wonder if there actually is an alternate reality where what Rick Santorum makes sense, and we're just not privy to it. Much as they are not privy to our world, where Rick is full of Santorum.

      Your post: a perfect example of sense being spoken and crazy being heard.

      (duck. Oy!!... just kidding, man, just kidding!)

      --
      Questions raise, answers kill. Raise questions to stay alive.
    2. Re:Tech Support by pixelpusher220 · · Score: 1

      Indeed. Such as listening to their brains fry when you ask them this:

      So if you believe that the government shouldn't be involved in religion at all...you obviously believe that polygamy should be legal right Mr. Romney?

      --
      People in cars cause accidents....accidents in cars cause people :-D
  4. Maybe I've been reading Slashdot too long... by idontgno · · Score: 4, Funny

    but the first thing I thought of when I read that scientists can now detect what is being heard is: "I wonder before the copyright police make this implant technology mandatory in order to catch unlicensed listening?"

    --
    Welcome to the Panopticon. Used to be a prison, now it's your home.
    1. Re:Maybe I've been reading Slashdot too long... by WillRobinson · · Score: 3, Funny

      Me to first thing I thought is there's the accuracy problem. They need 512....

    2. Re:Maybe I've been reading Slashdot too long... by Beardo+the+Bearded · · Score: 1

      I thought the same thing, "Oh, must be an 8-bit decoder."

      --

      ---
      ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
    3. Re:Maybe I've been reading Slashdot too long... by mug+funky · · Score: 1

      i think the 256 might actually be analogous to spectral bins - we hear in FFT land, IIRC.

      with 256 bins they could run something like shazam, then charge for some poor bugger who's had "octopuses garden" stuck in their head for a week.

    4. Re:Maybe I've been reading Slashdot too long... by LordLucless · · Score: 1

      poor bugger who's had "octopuses garden" stuck in their head for a week

      You bastard

      --
      Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
  5. The RIAA's next project by maxwell+demon · · Score: 1

    Soon everyone will be forced to have such an implant, so that people can be properly billed for every music they hear.

    --
    The Tao of math: The numbers you can count are not the real numbers.
  6. Misleading summary. by Anonymous Coward · · Score: 1

    From the PLoS paper: "To assess decoding accuracy, the reconstructed spectrogram is compared to the spectrogram of the original acoustic waveform". The number of words used in the experiment was 47 and the reconstructed spectrogram was compared to the 47 spectrograms of acoustic waveforms used in the experiment. That could be done with 90% accuracy. If the input waveform would have been unknown, the reconstruction would not aid at all in knowing what word the patient listened to.

    1. Re:Misleading summary. by ozydingo · · Score: 1

      If the input waveform would have been unknown, the reconstruction would not aid at all in knowing what word the patient listened to.

      Why do you say "not aid at all"? Audio can be reconstructed from spectrograms, and computer matching algorithms can match spectrograms to words (that's basically how they usually do speech recognition). So while accuracy might not have been quite 90% on an open set of unknown words, the procedure would still aid at least a little.

  7. Re:Look out! by Anonymous Coward · · Score: 1

    More likely, this will be part of the new and improved Siri. There will be a bunch of captured Android developers being held as slaves at Apple, with their skulls cut open, performing voice recognition for the more difficult queries.

    Within a decade, we'll learn how to grow human brains in a test-tube, and then equip one to each phone. I love the future!

  8. And soon... by Esteanil · · Score: 1

    And soon gangsters are gonna need MRIs to ensure someone isn't carrying surveillance gear...

    --
    I'm a dreamer, the world is my playpen. But hey, I'm a serious person, I can't dream all the time.
    1. Re:And soon... by cheater512 · · Score: 3, Informative

      That could be fatal and probably very very messy for the would-be snitch.

  9. Re:Wouldn't it just be easier to plant a microphon by alphamax · · Score: 5, Insightful

    Because a microphone that is on a person's body is going to pick up everything that person hears as well.

    And for that matter, it will probably be loads more reliable than trying to decode electrical signals that we are only just beginning to comprehend.

    Experiments such as this one are the reason we are beginning to comprehend the electrical signals in the brain. The goal of the experiment isn't to understand WHAT the patients are hearing, but HOW the patients are hearing.

  10. Re:Wow... imagine that! by PCM2 · · Score: 4, Insightful

    That the electrical signals received by the brain from the ear would actually directly correspond to the actual soundwaves received by the ear...

    I'm sorry... but in what way is this any more revolutionary in discovery than the telephone?

    It's brain research. Plain and simple.

    They already have devices that can translate the sound waves received by the ear into electrical impulses that are sent directly to the auditory nerves to be interpreted by the brain. They're called cochlear implants.

    This, on the other hand, is reading how the other end of the line interprets the impulses -- what happens within the brain when the electrical impulses are received. We still don't know all that much about how the brain really works. But when you can read changes in the brain with sufficient fidelity to be able to deduce what word the brain is thinking about, you can be pretty sure your hunch about how the brain works is correct.

    --
    Breakfast served all day!
  11. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    Hey, I'm not dissing finding out more about how the brain works.... but being able to detect what a person hears is really no more complicated than putting a microphone near that person.

  12. Re:Wow... imagine that! by mark-t · · Score: 1

    Yes. *THAT* would be revolutionary.

    Also, pretty scary, if you think about the possible ways such technology could be abused.

  13. 256 electrodes? by Yvan256 · · Score: 1

    Why? They can't afford a 16-bit microcontroller?

  14. Re:Wouldn't it just be easier to plant a microphon by timeOday · · Score: 1
    Ugh, no. For one thing, your brain is similarly activated when you THINK about words as when you hear them, so this kind of work demonstrates the possibility of a brain/computer interface.

    It should also be possible to prompt you (or force you) to think about the word (either its meaning, or to hallucinate the sound, depending on where you link in) by injecting a current, enabling a more direct link to an external memory, such as the Internet.

    The HUGE catch in all this is it requires an inter-cranial electrode array, which is currently only justified when there is some dire medical need for it, such as people constantly plagued by severe seizures. What we really need is a less invasive way to get those into there.

  15. Re:Wouldn't it just be easier to plant a microphon by timeOday · · Score: 1

    Sorry, "intra-cranial," i.e. inside your skull. Otherwise the sensing is much more limited (EEG).

  16. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    For one thing, your brain is similarly activated when you THINK about words as when you hear them

    While this has been postulated before, to the best of my knowledge, this premise has yet to be conclusively proven.

    Of course, being able to determine what words people are thinking of is a *HUGE* deal... and one that has almost frightening consequences.

  17. Re:Wouldn't it just be easier to plant a microphon by an+unsound+mind · · Score: 1

    Being able to reconstruct the sound from analyzing electrical signals in the brain, however?

    This could be groundbreaking research. Especially for hearing implants.

  18. Re:Wouldn't it just be easier to plant a microphon by alphamax · · Score: 1

    Oh, I follow you now..."Brain implants can detect what patients hear"...so do microphones, clever :)

  19. Re:Wouldn't it just be easier to plant a microphon by Anonymous Coward · · Score: 1

    Can't see the forest for the trees.

    Summary seems to be hung up on the reconstructed words aspect, so not entirely your fault. Still, go back and reread what alphamax posted.

    "The goal of the experiment isn't to understand WHAT the patients are hearing, but HOW the patients are hearing."

    The experimenters already knew what the people were hearing, they were playing back prerecorded words. More formally, the question is "How does the human auditory system extract perceptually relevant acoustic features of speech?"

  20. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    Well, if they are hearing the sound at the time, then no... I'm afraid I don't think that's a big a deal. The electrical signals transmitted from the eardrum to the brain would naturally have a pretty tight correspondence with the sound waves received, and I would naturally expect that electrical activity in the brain corresponding to regions associated with hearing would be similarly correspondent. The breakthrough will happen when they can construct the sound directly from what they are thinking, and not simply actually hearing with their ears.

  21. zOMG! I have Siri in my brain?!!! by Motard · · Score: 1

    Maybe my idea of using VR goggles and a dataglove to create a virtual a rolodex wasn't so crazy after all.

  22. Well yes - but did you know that ... by Crypto+Gnome · · Score: 2

    Breast Implants Can hear What you're Thinking!

    --
    Visit CryptoGnome in his home.
    1. Re:Well yes - but did you know that ... by russotto · · Score: 1

      Breast Implants Can hear What you're Thinking!

      Utter (udder?) nonsense. "Nice tits" was just a lucky guess.

  23. I need one of those like I need a hole in the head by Un+pobre+guey · · Score: 3, Interesting

    Eventually, holes will not be necessary. Better SQUIDS + cuda = mind reading from a distance. By 2020 0r 2030 at the latest, I would conjecture.

  24. Re:DISINFORMATION. Already in widespread use. by Un+pobre+guey · · Score: 1

    You realize, of course, that's not true, right? That technology does not exist, nor will it for decades. Are you mocking those poor unfortunates that believe it, or are you one yourself?

  25. beat me to it. . by Master+Moose · · Score: 1

    I was contemplating following this line of research, but it seems that these guys got there before me. Must have read my mind!

    --
    . . .gone when the morning comes
  26. Re:Wouldn't it just be easier to plant a microphon by Z34107 · · Score: 1

    A pity the authors neglected to site your previous neurological research. Clearly you've got this all figured out.

    --
    DATABASE WOW WOW
  27. Re:DISINFORMATION. Already in widespread use. by Master+Moose · · Score: 1

    I can vouch that this is true. As a once high ranking "general" in the NWO, I oversaw the deployment of such devices to many individuals. Generally we searched out ill informed, paranoid crazies for this sort of work - After all, when you are intent in developing a world in your image, for your own means, there is no better "cluster" of individuals to keep your third eye on.

    Once we abducted these individuals we would take them to our underground labs - the ones provided to us and shared with the "greens". Here we would implant 3 bits of tech, one just behind the left ear (receiver), one just behind the right (transmitter) and an anal probe (signal boosting antenna). Much of this tech was developed in collaboration with the greens and Tesla who I believe is still chief science officer for the NWO.

    My being excluded from the NWO is a story for another time, but the only reason I am alive to tell you this tale now is that I have been using this technology myself to track my would-be assassins.

    --
    . . .gone when the morning comes
  28. Haven't these people heard of a microphone??? by __aaltlg1547 · · Score: 1

    Who the f*** pays these guys?

  29. Re:DISINFORMATION. Already in widespread use. by couchslug · · Score: 1

    Delectable special insight gives the possessor enhanced comfort from their preferred explanation for a scary world.

    See also: religion.

    --
    "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
  30. Re:DISINFORMATION. Already in widespread use. by Saintwolf · · Score: 1

    lol. Enough said.

  31. Simstim decks by VAXcat · · Score: 1

    Cowboys didn't get into simstim, he thought, because it was basically a meat toy. He knew that ... the cyberspace matrix was actually a drastic simplification of the human sensorium, at least in terms of presentation, but simstim itself struck him as a gratuitous multiplication of flesh input.

    --
    There is no God, and Dirac is his prophet.
  32. Re:Look out! by pixelpusher220 · · Score: 1

    After neurosurgeons cut a hole in their skulls....A computer was able to reconstruct the original word 80 to 90 percent of the time.

    And that word was, I'm guessing...."OWWWW STOP DRILLING IN MY HEAD!!!!!"

    --
    People in cars cause accidents....accidents in cars cause people :-D
  33. Re:Wouldn't it just be easier to plant a microphon by SleazyRidr · · Score: 1

    Hey, I'm not dissing finding out more about how the brain works....

    Really? After reading your other two posts it sounds an awful lot like you are.

  34. Re:Look out! by HTH+NE1 · · Score: 1

    It's just a (wire)tap on the head.

    --
    Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
  35. Re:Wouldn't it just be easier to plant a microphon by ozydingo · · Score: 1

    The electrical signals transmitted from the eardrum to the brain would naturally have a pretty tight correspondence with the sound waves received

    Near the ear (i.e., auditory nerve), that would be mostly correct. For low frequencies (<2 kHz), the summed impulses on the auditory nerve look very much like the acoustic signal. For high frequencies, they look only like the overall envelope of the acoustic signal, but that's still pretty good and good enough to figure out most speech.

    and I would naturally expect that electrical activity in the brain corresponding to regions associated with hearing would be similarly correspondent.

    Mostly incorrect. Neurons in cortex fire very slowly (on the order of Hz), often eve nonce per "signal" (loosely defined, discrete chunk of audio). The pathway goes auditory nerve > cochlear nucleus > superior olive > lateral lemniscus > inferior colliculus > medial geniculate > auditory cortex. Very cool, complex computations are being performed at every stage that transform a time waveform received at the eardrum to a perception of sound and the world around you. To understand what the signals at the cortex mean is a huge insight toward reverse-engineering the brain, so don't knock it before you understand it.