Slashdot Mirror


Brain Implants Can Detect What Patients Hear

kkleiner writes "A group of 15 patients suffering from either epileptic seizures or brain tumors volunteered to allow scientists to insert electrodes into their brains. After neurosurgeons cut a hole in their skulls, the research team placed 256 electrodes over the part of the brain that processes auditory signals called the temporal lobe. The scientists then played words, one at a time, to the patients while recording brain activity in the temporal lobe. A computer was able to reconstruct the original word 80 to 90 percent of the time."

75 comments

  1. Look out! by Anonymous Coward · · Score: 0

    Here come the thought police!!!

    1. Re:Look out! by Anonymous Coward · · Score: 1

      More likely, this will be part of the new and improved Siri. There will be a bunch of captured Android developers being held as slaves at Apple, with their skulls cut open, performing voice recognition for the more difficult queries.

      Within a decade, we'll learn how to grow human brains in a test-tube, and then equip one to each phone. I love the future!

    2. Re:Look out! by pixelpusher220 · · Score: 1

      After neurosurgeons cut a hole in their skulls....A computer was able to reconstruct the original word 80 to 90 percent of the time.

      And that word was, I'm guessing...."OWWWW STOP DRILLING IN MY HEAD!!!!!"

      --
      People in cars cause accidents....accidents in cars cause people :-D
    3. Re:Look out! by HTH+NE1 · · Score: 1

      It's just a (wire)tap on the head.

      --
      Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
  2. Brave New World by Foxhoundz · · Score: 3

    We need more articles like this. It's an encouraging progress in neuroscience.

  3. I see big potential here by GodfatherofSoul · · Score: 4, Funny

    My dreams of a womanspeak translator implant are on the horizon. Now, if they can just develop the technology to translate "Leave me the fuck alone until the game is over." into a more palatable sentence...

    --
    I swear to God...I swear to God! That is NOT how you treat your human!
    1. Re:I see big potential here by powerspike · · Score: 0

      Hunny, if you wish to talk to me about X during the game, I'll be more then happy to talk to you Y when is on. There you go...

    2. Re:I see big potential here by Anonymous Coward · · Score: 0

      Oh go shag a honeydew melon

    3. Re:I see big potential here by Anonymous Coward · · Score: 1

      "Leave me the fuck alone until the game is over."

      That's what I tell my girlfriend during our weekly Pathfinder game!

      Then she kills my character, 'cause she's the GM. :-(

    4. Re:I see big potential here by dreamchaser · · Score: 2, Funny

      Hunny, if you wish to talk to me about X during the game, I'll be more then happy to talk to you Y when is on.

      There you go...

      You obviously haven't studied enough Chaos Theory to think womanspeak breaks down into anything logical.

    5. Re:I see big potential here by mug+funky · · Score: 1

      dude, you're meant to be doing man things, like reaching high objects, changing tyres, and opening stuck jar lids.

    6. Re:I see big potential here by Saintwolf · · Score: 1

      Hunny, if you wish to talk to me about X during the game, I'll be more then happy to talk to you Y when is on.

      There you go...

      You obviously haven't studied enough Chaos Theory to think womanspeak breaks down into anything logical.

      He sounds fairly illogical to me, but that could just be the bad syntax on his part.

  4. Tech Support by swsuehr · · Score: 4, Insightful

    Earlier in my career when I had to do level 1 tech support I might have liked opportunity to cut holes in skulls to make sure people heard what was being said. However, *hearing* what's being said and actually processing that into meaningful and actionable instructions are two different things.

    1. Re:Tech Support by sneakyimp · · Score: 0

      mod parent up. When you speak sense to certain folks, they hear crazy talk. And, conversely, crazy talk (e.g., anything said by pRick Santorum) makes sense to them.

    2. Re:Tech Support by Anonymous Coward · · Score: 0, Troll

      Sometimes this thought scares me. It makes me wonder if there actually is an alternate reality where what Rick Santorum makes sense, and we're just not privy to it. Much as they are not privy to our world, where Rick is full of Santorum.

    3. Re:Tech Support by c0lo · · Score: 1

      Sometimes this thought scares me. It makes me wonder if there actually is an alternate reality where what Rick Santorum makes sense, and we're just not privy to it. Much as they are not privy to our world, where Rick is full of Santorum.

      Your post: a perfect example of sense being spoken and crazy being heard.

      (duck. Oy!!... just kidding, man, just kidding!)

      --
      Questions raise, answers kill. Raise questions to stay alive.
    4. Re:Tech Support by pixelpusher220 · · Score: 1

      Indeed. Such as listening to their brains fry when you ask them this:

      So if you believe that the government shouldn't be involved in religion at all...you obviously believe that polygamy should be legal right Mr. Romney?

      --
      People in cars cause accidents....accidents in cars cause people :-D
  5. Pretty neat. by Anonymous Coward · · Score: 0

    It's pretty neat they can do this when they are doing the equivalent of a voltmeter to figure out how a processor works.

    1. Re:Pretty neat. by Anonymous Coward · · Score: 0

      It's a bit more sophisticated than that -- I'd say the proper analogy is like using a 20MHz 'scope to analyze a GHz-range processor.

  6. Maybe I've been reading Slashdot too long... by idontgno · · Score: 4, Funny

    but the first thing I thought of when I read that scientists can now detect what is being heard is: "I wonder before the copyright police make this implant technology mandatory in order to catch unlicensed listening?"

    --
    Welcome to the Panopticon. Used to be a prison, now it's your home.
    1. Re:Maybe I've been reading Slashdot too long... by WillRobinson · · Score: 3, Funny

      Me to first thing I thought is there's the accuracy problem. They need 512....

    2. Re:Maybe I've been reading Slashdot too long... by Beardo+the+Bearded · · Score: 1

      I thought the same thing, "Oh, must be an 8-bit decoder."

      --

      ---
      ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
    3. Re:Maybe I've been reading Slashdot too long... by Anonymous Coward · · Score: 0

      Or even worse, unlicensed reminiscing.

    4. Re:Maybe I've been reading Slashdot too long... by Anonymous Coward · · Score: 0

      Would you like to bet real money on that?

      Yes. Yes I would. I've got AU$50 in whatever form is convenient for you for something resembling a citation for the claim of a "MRI cannon" in the form of a "hand-held highway radar gun" that's "good enough to read passwords [from your mind] as you type them".

      I could use a few dollars and a nice place to sleep and shower for a few days.

      I thought you were past all that? That might explain the backsliding into things like gambling, then.

    5. Re:Maybe I've been reading Slashdot too long... by mug+funky · · Score: 1

      i think the 256 might actually be analogous to spectral bins - we hear in FFT land, IIRC.

      with 256 bins they could run something like shazam, then charge for some poor bugger who's had "octopuses garden" stuck in their head for a week.

    6. Re:Maybe I've been reading Slashdot too long... by LordLucless · · Score: 1

      poor bugger who's had "octopuses garden" stuck in their head for a week

      You bastard

      --
      Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
    7. Re:Maybe I've been reading Slashdot too long... by Anonymous Coward · · Score: 0

      Incriminating "unlicensed listening" -- isn't it what ACTA is about?

  7. The RIAA's next project by maxwell+demon · · Score: 1

    Soon everyone will be forced to have such an implant, so that people can be properly billed for every music they hear.

    --
    The Tao of math: The numbers you can count are not the real numbers.
  8. Wow... imagine that! by mark-t · · Score: 0

    That the electrical signals received by the brain from the ear would actually directly correspond to the actual soundwaves received by the ear...

    I'm sorry... but in what way is this any more revolutionary in discovery than the telephone?

    1. Re:Wow... imagine that! by Anonymous Coward · · Score: 0

      Indeed. It would make a better story if they could reconstruct words the patient was

      thinking of

      (without hearing them)

    2. Re:Wow... imagine that! by PCM2 · · Score: 4, Insightful

      That the electrical signals received by the brain from the ear would actually directly correspond to the actual soundwaves received by the ear...

      I'm sorry... but in what way is this any more revolutionary in discovery than the telephone?

      It's brain research. Plain and simple.

      They already have devices that can translate the sound waves received by the ear into electrical impulses that are sent directly to the auditory nerves to be interpreted by the brain. They're called cochlear implants.

      This, on the other hand, is reading how the other end of the line interprets the impulses -- what happens within the brain when the electrical impulses are received. We still don't know all that much about how the brain really works. But when you can read changes in the brain with sufficient fidelity to be able to deduce what word the brain is thinking about, you can be pretty sure your hunch about how the brain works is correct.

      --
      Breakfast served all day!
    3. Re:Wow... imagine that! by mark-t · · Score: 1

      Yes. *THAT* would be revolutionary.

      Also, pretty scary, if you think about the possible ways such technology could be abused.

  9. Misleading summary. by Anonymous Coward · · Score: 1

    From the PLoS paper: "To assess decoding accuracy, the reconstructed spectrogram is compared to the spectrogram of the original acoustic waveform". The number of words used in the experiment was 47 and the reconstructed spectrogram was compared to the 47 spectrograms of acoustic waveforms used in the experiment. That could be done with 90% accuracy. If the input waveform would have been unknown, the reconstruction would not aid at all in knowing what word the patient listened to.

    1. Re:Misleading summary. by ozydingo · · Score: 1

      If the input waveform would have been unknown, the reconstruction would not aid at all in knowing what word the patient listened to.

      Why do you say "not aid at all"? Audio can be reconstructed from spectrograms, and computer matching algorithms can match spectrograms to words (that's basically how they usually do speech recognition). So while accuracy might not have been quite 90% on an open set of unknown words, the procedure would still aid at least a little.

  10. Wouldn't it just be easier to plant a microphone? by mark-t · · Score: 0

    Because a microphone that is on a person's body is going to pick up everything that person hears as well.

    And for that matter, it will probably be loads more reliable than trying to decode electrical signals that we are only just beginning to comprehend.

  11. Wasn't this posted a week or two ago? by Anonymous Coward · · Score: 0

    Maybe I didn't read it here, but I'm pretty sure I did.

  12. And soon... by Esteanil · · Score: 1

    And soon gangsters are gonna need MRIs to ensure someone isn't carrying surveillance gear...

    --
    I'm a dreamer, the world is my playpen. But hey, I'm a serious person, I can't dream all the time.
    1. Re:And soon... by cheater512 · · Score: 3, Informative

      That could be fatal and probably very very messy for the would-be snitch.

    2. Re:And soon... by Anonymous Coward · · Score: 0

      Bonus!

  13. Re:Wouldn't it just be easier to plant a microphon by alphamax · · Score: 5, Insightful

    Because a microphone that is on a person's body is going to pick up everything that person hears as well.

    And for that matter, it will probably be loads more reliable than trying to decode electrical signals that we are only just beginning to comprehend.

    Experiments such as this one are the reason we are beginning to comprehend the electrical signals in the brain. The goal of the experiment isn't to understand WHAT the patients are hearing, but HOW the patients are hearing.

  14. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    Hey, I'm not dissing finding out more about how the brain works.... but being able to detect what a person hears is really no more complicated than putting a microphone near that person.

  15. Deja Vu All Over Again by Anonymous Coward · · Score: 0

    I could have sworn that I saw this story before on /.

  16. 256 electrodes? by Yvan256 · · Score: 1

    Why? They can't afford a 16-bit microcontroller?

  17. Re:Wouldn't it just be easier to plant a microphon by timeOday · · Score: 1
    Ugh, no. For one thing, your brain is similarly activated when you THINK about words as when you hear them, so this kind of work demonstrates the possibility of a brain/computer interface.

    It should also be possible to prompt you (or force you) to think about the word (either its meaning, or to hallucinate the sound, depending on where you link in) by injecting a current, enabling a more direct link to an external memory, such as the Internet.

    The HUGE catch in all this is it requires an inter-cranial electrode array, which is currently only justified when there is some dire medical need for it, such as people constantly plagued by severe seizures. What we really need is a less invasive way to get those into there.

  18. Re:Wouldn't it just be easier to plant a microphon by timeOday · · Score: 1

    Sorry, "intra-cranial," i.e. inside your skull. Otherwise the sensing is much more limited (EEG).

  19. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    For one thing, your brain is similarly activated when you THINK about words as when you hear them

    While this has been postulated before, to the best of my knowledge, this premise has yet to be conclusively proven.

    Of course, being able to determine what words people are thinking of is a *HUGE* deal... and one that has almost frightening consequences.

  20. Re:Wouldn't it just be easier to plant a microphon by an+unsound+mind · · Score: 1

    Being able to reconstruct the sound from analyzing electrical signals in the brain, however?

    This could be groundbreaking research. Especially for hearing implants.

  21. Re:Wouldn't it just be easier to plant a microphon by alphamax · · Score: 1

    Oh, I follow you now..."Brain implants can detect what patients hear"...so do microphones, clever :)

  22. Re:Wouldn't it just be easier to plant a microphon by Anonymous Coward · · Score: 1

    Can't see the forest for the trees.

    Summary seems to be hung up on the reconstructed words aspect, so not entirely your fault. Still, go back and reread what alphamax posted.

    "The goal of the experiment isn't to understand WHAT the patients are hearing, but HOW the patients are hearing."

    The experimenters already knew what the people were hearing, they were playing back prerecorded words. More formally, the question is "How does the human auditory system extract perceptually relevant acoustic features of speech?"

  23. Re:Wouldn't it just be easier to plant a microphon by mark-t · · Score: 1

    Well, if they are hearing the sound at the time, then no... I'm afraid I don't think that's a big a deal. The electrical signals transmitted from the eardrum to the brain would naturally have a pretty tight correspondence with the sound waves received, and I would naturally expect that electrical activity in the brain corresponding to regions associated with hearing would be similarly correspondent. The breakthrough will happen when they can construct the sound directly from what they are thinking, and not simply actually hearing with their ears.

  24. Re:Wouldn't it just be easier to plant a microphon by Anonymous Coward · · Score: 0

    What if you're trying to figure out if a hearing problem is in the cochlea or in the wetware?

  25. zOMG! I have Siri in my brain?!!! by Motard · · Score: 1

    Maybe my idea of using VR goggles and a dataglove to create a virtual a rolodex wasn't so crazy after all.

  26. DISINFORMATION. Already in widespread use. by Roark+Meets+Dent · · Score: 0, Funny

    These stories about how the technology is still in the experimental stages are all bogus and intentional disinformation. Many thousands of people already have their brains implanted with this tech 100% NON-CONSENSUALLY. It is called synthetic telepathy. It transmits not only what you hear but what you see, think and feel back to the originator. Just google "targeted individuals or "synthetic telepathy" and you will see what I mean.

    A lot of new age people are duped into thinking they have developed telepathic powers due to being "spiritually advanced" or "in tune with the earth" or other such BS. In reality they are MKULTRA mind control victims of the present day.

    Military black operations have been carried out for years to put the tech into people's heads. Remember all those "alien abduction" stories in the media for the past 10-20 years? Those people really were being abducted and implanted, but not by aliens.

    For more information visit http://www.karlaturner.org/

    1. Re:DISINFORMATION. Already in widespread use. by couchslug · · Score: 0

      It's called "schizophrenia", and the cure is suicide.

      The idea that there is reason to implant some average shmuck implies the shmuck has value, so schizo-shmucks embrace the concept.

      It doesn't require implants to manipulate dumbfucks. Religion and Advertising work just fine.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    2. Re:DISINFORMATION. Already in widespread use. by Un+pobre+guey · · Score: 1

      You realize, of course, that's not true, right? That technology does not exist, nor will it for decades. Are you mocking those poor unfortunates that believe it, or are you one yourself?

    3. Re:DISINFORMATION. Already in widespread use. by Master+Moose · · Score: 1

      I can vouch that this is true. As a once high ranking "general" in the NWO, I oversaw the deployment of such devices to many individuals. Generally we searched out ill informed, paranoid crazies for this sort of work - After all, when you are intent in developing a world in your image, for your own means, there is no better "cluster" of individuals to keep your third eye on.

      Once we abducted these individuals we would take them to our underground labs - the ones provided to us and shared with the "greens". Here we would implant 3 bits of tech, one just behind the left ear (receiver), one just behind the right (transmitter) and an anal probe (signal boosting antenna). Much of this tech was developed in collaboration with the greens and Tesla who I believe is still chief science officer for the NWO.

      My being excluded from the NWO is a story for another time, but the only reason I am alive to tell you this tale now is that I have been using this technology myself to track my would-be assassins.

      --
      . . .gone when the morning comes
    4. Re:DISINFORMATION. Already in widespread use. by Anonymous Coward · · Score: 0

      Every single time, without fail, that a legitimate person tries to talk about the deployment of this technology, some JACKASS shows up within minutes throwing around the word "schizophrenia" to try and discredit the reporter.

      According to the University of Manchester School of Psychology, SCHIZOPHRENIA MAY NOT EVEN EXIST.
      http://www.psych-sci.manchester.ac.uk/aboutus/news/schizophrenia

      Do some research and you will find that false psychiatric have been in use by governments as a pretext to incarcerate political dissidents. The Soviet Union was notorious for this, but now it is happening in the USA and most other western countries as well.

    5. Re:DISINFORMATION. Already in widespread use. by couchslug · · Score: 1

      Delectable special insight gives the possessor enhanced comfort from their preferred explanation for a scary world.

      See also: religion.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    6. Re:DISINFORMATION. Already in widespread use. by Saintwolf · · Score: 1

      lol. Enough said.

  27. Of course... by Anonymous Coward · · Score: 0

    played words, one at a time, to the patients while recording brain activity in the temporal lobe

    If they'd played all the words at the same time instead of one at a time, the electrodes would have exploded from being over driven by an over stimulated brain.

  28. Well yes - but did you know that ... by Crypto+Gnome · · Score: 2

    Breast Implants Can hear What you're Thinking!

    --
    Visit CryptoGnome in his home.
    1. Re:Well yes - but did you know that ... by russotto · · Score: 1

      Breast Implants Can hear What you're Thinking!

      Utter (udder?) nonsense. "Nice tits" was just a lucky guess.

  29. I need one of those like I need a hole in the head by Un+pobre+guey · · Score: 3, Interesting

    Eventually, holes will not be necessary. Better SQUIDS + cuda = mind reading from a distance. By 2020 0r 2030 at the latest, I would conjecture.

  30. beat me to it. . by Master+Moose · · Score: 1

    I was contemplating following this line of research, but it seems that these guys got there before me. Must have read my mind!

    --
    . . .gone when the morning comes
  31. Re:Wouldn't it just be easier to plant a microphon by Z34107 · · Score: 1

    A pity the authors neglected to site your previous neurological research. Clearly you've got this all figured out.

    --
    DATABASE WOW WOW
  32. Haven't these people heard of a microphone??? by __aaltlg1547 · · Score: 1

    Who the f*** pays these guys?

  33. Tin Foil by Anonymous Coward · · Score: 0

    Could these scientists tin foil my skull?

  34. Why is this considered an advancement? by Anonymous Coward · · Score: 0

    That's not that amazing really...

    This level of accuracy (or higher) is about what speech software (Dragon or Siri) is achieving by just listening to the sound waves themselves. So if anything, the ear and cochlear filter and clean the signal (removing background noise) so it should be easier to use this signal to interpret the words.

  35. Tinnitus treatments by Anonymous Coward · · Score: 0

    Hopefully research work like this will lead to cures for conditions like Tinnitus, the ringing sound that people hear. It's already apparent that the ringing noises don't always originate in the ear as severing the auditory nerve to the brain doesn't always get rid of the ringing sound. It seems the brain is involved in generating the noisy signal.

    If work like this indicates where the false sound is coming from, perhaps another, active, implant could eliminate it.

  36. Simstim decks by VAXcat · · Score: 1

    Cowboys didn't get into simstim, he thought, because it was basically a meat toy. He knew that ... the cyberspace matrix was actually a drastic simplification of the human sensorium, at least in terms of presentation, but simstim itself struck him as a gratuitous multiplication of flesh input.

    --
    There is no God, and Dirac is his prophet.
  37. Re:Wouldn't it just be easier to plant a microphon by SleazyRidr · · Score: 1

    Hey, I'm not dissing finding out more about how the brain works....

    Really? After reading your other two posts it sounds an awful lot like you are.

  38. 1984 with WiFi by Anonymous Coward · · Score: 0

    Citizen 392417, your aural implant has detected that you were just made a bribery offer. Do not attempt to deny it, we have the transcript right here...

  39. Re:Wouldn't it just be easier to plant a microphon by ozydingo · · Score: 1

    The electrical signals transmitted from the eardrum to the brain would naturally have a pretty tight correspondence with the sound waves received

    Near the ear (i.e., auditory nerve), that would be mostly correct. For low frequencies (<2 kHz), the summed impulses on the auditory nerve look very much like the acoustic signal. For high frequencies, they look only like the overall envelope of the acoustic signal, but that's still pretty good and good enough to figure out most speech.

    and I would naturally expect that electrical activity in the brain corresponding to regions associated with hearing would be similarly correspondent.

    Mostly incorrect. Neurons in cortex fire very slowly (on the order of Hz), often eve nonce per "signal" (loosely defined, discrete chunk of audio). The pathway goes auditory nerve > cochlear nucleus > superior olive > lateral lemniscus > inferior colliculus > medial geniculate > auditory cortex. Very cool, complex computations are being performed at every stage that transform a time waveform received at the eardrum to a perception of sound and the world around you. To understand what the signals at the cortex mean is a huge insight toward reverse-engineering the brain, so don't knock it before you understand it.