Slashdot Mirror


University of Columbia Researchers Translate Brain Signals Directly Into Speech (columbia.edu)

dryriver writes: There is good news for people who have limited or no ability to speak, due to having suffered a stroke for example. Researchers at Columbia University have managed to turn brain signals in the auditory cortex of test subjects into somewhat intelligible speech using a vocoder-like system with audio output cleaned up by neural networks. The findings have been published in the journal Nature. Here's an excerpt from the Zuckerman Institute's press release, which contains example audio of a number sequence being turned into robotic speech: "In a scientific first, Columbia neuroengineers have created a system that translates thought into intelligible, recognizable speech. By monitoring someone's brain activity, the technology can reconstruct the words a person hears with unprecedented clarity. This breakthrough, which harnesses the power of speech synthesizers and artificial intelligence, could lead to new ways for computers to communicate directly with the brain. It also lays the groundwork for helping people who cannot speak, such as those living with amyotrophic lateral sclerosis (ALS) or recovering from stroke, regain their ability to communicate with the outside world."

13 of 84 comments (clear)

  1. Transcript by Anonymous Coward · · Score: 2, Funny

    Dear aunt let's so double the killer delete select all

  2. Captain Pike will be thrilled! by spiritplumber · · Score: 3

    Seriously though, this is amazing.

    --
    Liberty - Security - Laziness - Pick any two.
    1. Re:Captain Pike will be thrilled! by PolygamousRanchKid+ · · Score: 3, Informative

      Seriously though, this is amazing.

      I agree. However, I'm afraid that the police, NSA, CIA, DHS and their pals will discover the usefulness of this neat new toy.

      Well, at least they might stop water boarding people.

      Before you enter the US, we'd like you to put on this funny hat, and ask you a few questions. Don't bother answering; the computer will speak your thoughts for you.

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
  3. "I'm hungry. Boobs! What should I order? Boobs!" by SensitiveMale · · Score: 5, Funny

    "Yes, I'd like to order a Big Mac BOOBS! Good Lord look at those boobs! Ummm, some fries and a My God those boobies are huge! Umm and diet coke. Damn, those of tig ass bitties!"

    That's what every guy's brain is thinking.

  4. Obligatory by Miles_O'Toole · · Score: 4, Funny

    Now they just have to figure out how Trump manages to generate speech while demonstrating no measurable brain activity.

    --
    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.
  5. Brain microphone, not brain speech synthetizer by abies · · Score: 5, Interesting

    Please note that while it seems like they cracked translating thought into speed, it is really about something very different. They decode what person is hearing into sound. This is very, very far from being able to interpret actual thoughts - they attach themselves to very early stage of hearing process, where things are still looking very much like sound waves. Additionally, it is tested on just 10 words (numbers from 0 to 9). On top of that, given neural nets are magic, I wouldn't be surprised if instead on brain activity, they focused on some measurement artifact, which is caused by skull vibrating to the sound, turning all that setup into overcomplicated and underperforming microphone. Sure, it is a worthy research, but it is light years away from thoughts to speech conversion.

    1. Re:Brain microphone, not brain speech synthetizer by teslar · · Score: 3, Interesting

      Yes, this.

      The only thing I would add is that we do know that higher-level cognitive processes re-activate sensorimotor parts of the brain; so thinking the number "nine" might cause some activation similar to hearing that number.

      So, assuming they didn't indeed just pick up on some non-neural artifact, this shows that there is potential - at least in the ideal case where we know the signal is as good as it's ever going to get. It's one step in the direction of being able to deal with weaker, noisier versions you might get from reactivation.

      But yeah, noone's going to read your thoughts anytime soon.

    2. Re:Brain microphone, not brain speech synthetizer by petes_PoV · · Score: 2

      This is very, very far from being able to interpret actual thoughts - they attach themselves to very early stage of hearing process, where things are still looking very much like sound waves.

      Yes. My first thought when I read the headline was: what language is the speech in?

      But it seems that this work, while interesting in an academic sense, is far from what the headline indicates.

      --
      politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  6. Read my mind by MicroSlut · · Score: 2

    Have they tried using this on a dog yet?

  7. Re:"I'm hungry. Boobs! What should I order? Boobs! by sad_ · · Score: 2

    from TFA;

    “In this scenario, if the wearer thinks ‘I need a glass of water,’ our system could take the brain signals generated by that thought, and turn them into synthesized, verbal speech,” said Dr. Mesgarani.

    it clearly says it will vocalize what the brain is thinking. unless there is an easy way to turn that off/on i don't think anybody actually wants something like that.

    --
    On a long enough timeline, the survival rate for everyone drops to zero.
  8. Re: "I'm hungry. Boobs! What should I order? Boobs by Vintermann · · Score: 3, Interesting

    It would be creepy as hell, but very cool, to get a recording of the voices schizophrenics hear.

    --
    xkcd is not in the sudoers file. This incident will be reported.
  9. There must be a mistake by elrous0 · · Score: 2

    We hooked it up to Ariana Grande and it just keeps printing out "Need attention" over and over.

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
  10. Re:What if by lgw · · Score: 2

    What if you have Tourettes syndrome

    Fun fact: profanity comes from a different part of the brain from normal speech. That's why Tourettes can even exist. That part of the brain is, as much as we can reason between species, the part of the brain that other apes and monkeys use for warning vocalizations. Literally "oh shit it's a snake!"

    --
    Socialism: a lie told by totalitarians and believed by fools.