Slashdot Mirror


NASA Develops Tech To Hear Words Not Yet Spoken

alex_guy_CA writes "Yahoo News has a story about technology that comes close to reading thoughts not yet spoken, by analyzing nerve commands to the throat. 'A person using the subvocal system thinks of phrases and talks to himself so quietly it cannot be heard, but the tongue and vocal cords do receive speech signals from the brain,' said developer Chuck Jorgensen, of NASA's Ames Research Center, Moffett Field, California. Jorgensen's team found that sensors under the chin and one each side of the Adam's apple pick up the brain's commands to the speech organs, allowing the subauditory, or 'silent speech' to be captured. The story indicates the method could be useful on space missions or other difficult working conditions."

49 of 466 comments (clear)

  1. sub-vocal communication by mmoncur · · Score: 5, Interesting

    Wow! Combine this with a transmitter and receiver, and you get the ability to have sub-vocal backchannel communication with people--I think it was Gregory Benford who wrote a series of books that featured something like this.

    Way better than text messaging.

    --

    It's Slashdot's evil twin... SlashNOT
    1. Re:sub-vocal communication by Cornelius+the+Great · · Score: 5, Informative

      The sequels to the Ender's Game (Orson Scott Card) books featured this technology as well. Ender would subvocalize with Jane, who travelled on the ansible.

      Good story, good universe. I hear there's an Ender's Game movie in the works.

      --
      Sigs are for losers
    2. Re:sub-vocal communication by sysbot · · Score: 4, Interesting

      How about interfacing with a computer? How's about mind control "everything"! This is cool!!

    3. Re:sub-vocal communication by Anonymous Coward · · Score: 5, Insightful
      Combine this with a transmitter and receiver, and you get the ability to have sub-vocal backchannel communication with people
      Or the ability to "wiretap" the things floating around in someone's head, the dissents they thought that they were voicing only to themselves.

      Thoughtcrime, indeed.
    4. Re:sub-vocal communication by John+Courtland · · Score: 4, Informative

      There's this thing called LASH... I forget exactly what the acronym means, but I think it means, Los Angeles Silent/SWAT Headset. It is basically a collar that goes around your throat, and you mouth the words you want to say, and everyone else with a reciever can hear them. You don't whisper, you just silently make the mouth gestures and the machine amplifies them. Perfect for a SWAT team, or pretty much any military force.

      --
      Slashdot is proof that Sturgeon's Law applies to mankind.
    5. Re:sub-vocal communication by beacher · · Score: 4, Funny

      Yeaah... This technology was featured in PootieTang! Pootie don't need no words. Don't even need no music!

    6. Re:sub-vocal communication by 4of12 · · Score: 3, Funny

      How about interfacing with a computer?

      You bet.

      $EXPLETIVE means "Undo".

      --
      "Provided by the management for your protection."
    7. Re:sub-vocal communication by StateOfTheUnion · · Score: 4, Informative
      LASH uses a throat microphone. It straps to the throat and you have to speak (make noise) for the microphone to pickup. The advantage of a throat microphone is that ambient noise is not picked up by the microphone. According to one of the vendors ( swatheadsets.com ) you are supposed to be able to be understood through the microphone while under the beating rotors of a helicopter.

      One disadvantage is that percussive sounds (In english, the sound of a "B", "T", "D" etc.) are not picked up by most throat mikes because these sounds are made mostly by the lips, not the throat.

    8. Re:sub-vocal communication by Doubting+Thomas · · Score: 3, Interesting

      That's probably where I've seen this before, then. I couldn't recall if it was Brin or Simmons where I'd seen this first.

      In Earth, wasn't there the added complication of not letting your thoughts wander so far that the computer mistakes idle wool-gathering as command input?

      It's really awkward to explain to the cops why your robotic lawnmower was chasing your annoying next door neighbor, or why your dishwasher tried to eat your girlfriend right after you two got into a big fight.

      --
      Just because it works, doesn't mean it isn't broken.
  2. So sort of like... by NSash · · Score: 5, Funny

    ...that system Ender used to talk to Jane? That would be sooo cool. (Now, all I need is an omniscient AI with root access on every machine connected to the Internet...)

    1. Re:So sort of like... by Chairboy · · Score: 3, Funny

      > Now, all I need is an omniscient AI with root
      > access on every machine connected to the
      > Internet...

      NSash, meet Nimda & Code Red.

  3. Could be dangerous by IANAL(BIAILS) · · Score: 5, Funny

    I mean - there are a lot of things that I *think* about some of my coworkers, especially during meetings, but I always am able to catch myself right before I say anything. You'd *really* have to watch yourself plugged into that thing!

    1. Re:Could be dangerous by indigeek · · Score: 5, Interesting

      It should not be too much of a problem once people get used to it. And it shouldnt be too much more difficult than to control than actually (vocally) talking without thinking.
      Humans right now are trained to keep their mouth shut even when they are thinking, or even talk exactly opposite of what they think. We yet are not used to controlling the previous level, ie subconsciously talking (ever noticed people at bus stops muttering to themselves or even smiling?) .Once this technology has become mainstream, we should be able to adapt and to think only at a brain level instead of translating into vocal commands. (Qustion: Do Spanish people think differently from Chinese people who don't have a proper phonetic language if they are thinking to themselves?)
      And I think we have done this before. Imagine a non-humanoid alien landing on earth. I am sure he would be surprised that all the humans can actually balance themselves on 2 foot and even run around (They would probably think it a waste trying to balance yourself on a point while crawling is much less brain intensive). And Imagine, these beings can even balance themselves on 2 inch thick wheels around a metre above earth (bicycles).And this technique has no evolutionary basis, almost all the humans learned it within a 100 years or so. Looks like a very adaptable race to me.

    2. Re:Could be dangerous by cevnet · · Score: 4, Interesting
      (Qustion: Do Spanish people think differently from Chinese people who don't have a proper phonetic language if they are thinking to themselves?)
      I've always wondered how people who haven't acquired language at all think. Is abstract thought possible without language?
    3. Re:Could be dangerous by Mr.+Slippery · · Score: 5, Insightful
      Is abstract thought possible without language?

      Yes. How could one aquire language if thought wasn't there already? Consider the rare feral children adults who have grown up without acquiring language - do you think they're "dark inside"? Or even more fascinating, Helen Keller, who acquired language late enough to have memories that pre-dated that acquisition.

      Consult any Zen master for further instruction - that which the Japanese call "mushin" ("no-mind") might be thought of as "thinking without words". (Of course, there is a difference between transcending linguistic thought, and never acquiring it in the first place.)

      But in thinking of mushin as thinking without words, you are thinking with words, and thus getting away from the actual phenomenon. Thus Zen Master Seung Sahn's observation "open mouth, already a mistake".

      Man is a thinking reed but his great works are when he is not calculating and thinking. "Childlikeness" has to be restored with long years of training in the art of self-forgetfulness. When this is attained, man thinks yet he does not think. He thinks like the showers coming down from the sky; he thinks like the waves rolling on the ocean; he thinks like the stars illuminating the nightly heavens; he thinks like the green foliage shooting forth in the relaxing spring breeze. Indeed, he is the showers, the ocean, the stars, the foliage. -- D.T. Suzuki
      --
      Tom Swiss | the infamous tms | my blog
      You cannot wash away blood with blood
  4. What? by Gary+Yogurt · · Score: 5, Funny

    Isn't that lip-reading technology we had on that Jupiter mission three years ago good enough?

  5. finally... by mattkime · · Score: 5, Funny

    ....they can hear you scream in space.

    --
    Know what I like about atheists? I've yet to meet one that believes God is on their side.
  6. As if the aliens weren't enough... by Anaxagor · · Score: 5, Funny

    Now I'll have to break out some more aluminium and extend the tinfoil hat into a full-face helmet.

  7. Benefit for Stephen Hawking? by william_lorenz · · Score: 5, Interesting

    I wonder if this could benefit Stephen Hawking? Good thing he's got friends at NASA. ;)

    1. Re:Benefit for Stephen Hawking? by Max+Romantschuk · · Score: 4, Informative

      Well, Hawking has a muscle disorder. Exactly what is involved in ALS is beyond me, whether it's just the muscles or if it's a problem with the nerves getting the signals to the muscles. If the problem is the formor, it may save him a lot of typing. If it's the latter, it would be of no use.

      ALS affects the motor neurons themselves, resulting in the signals never reaching the muscles. Oversimplified it's much like a an electric motor with a broken wire: the motor might be fine, but it gets no electricity and subsequently does nothing. ALS is the same, but human muscles also suffer serious deteriouration when not being used.

      In any case this technology it would be of no use, as the muscles are fine, but the nerves aren't.

      --
      .: Max Romantschuk :: http://max.romantschuk.fi/
  8. Words not yet spoken? by SmlFreshwaterBuffalo · · Score: 3, Insightful

    The title implies that this technology could predict speech before it is said, but the article explains that it can simply read people's conscious thoughts as they are occurring. Those seem to be two completely different things to me.

  9. Re:A little confused by tsunamifirestorm · · Score: 4, Insightful

    the ability to "hear" inaudible conversation is valuable in case there is a lot of outside noide (explosion?) or for psychological reasons (a crew member mutters something under his breath)

  10. Lie Detector by Nermal6693 · · Score: 5, Insightful

    This could potentially take a lie detector to a new level - people are likely going to think over their possible responses before replying, and this could be used to obtain those thoughts. Scary.

    1. Re:Lie Detector by Sancho · · Score: 4, Insightful

      It's scary if you want to be able to lie, or even just don't want your every conscious thought to be available to people.
      Imagine if one day, in the distant future, EVERYONE was required to have one of these, and ALL of their concious thoughts were analyzed in a Carnivore-like system. Thinking, "I'm going to bomb X embassy," even if you have no intention of doing it, could lead to investigations.
      Right now, our thoughts, our minds, are one of the few safe-havens we have. No one can force us to disclose our thoughts, barring the use of some chmicals that sometimes have a truth-inducing effect (fairly rare, though, because all it really makes you do is talk a lot, but not necessarily about what your interrogators want to hear), and these are very active. They have to grab you, inject you, interrogate you, and all this takes quite a bit of time. With subvocalizers, it would be much easier.

      It IS scary, even just as a lie detector, because what if I thought, "Man, that cop is hot!" while they're interrogating me. Pretty embarassing. And it could lead to a whole slew of fifth amendment issues, in the US.

  11. I'll take the Fifth - NOT! by Anonymous Coward · · Score: 5, Funny

    INTERROGATOR: "I'll ask you once more - Did you kill Mrs. Finkelstein?"

    PRISONER: "..."

    INTERROGATOR: "Aha! And where did you hide her body?"

    1. Re: I'll take the Fifth - NOT! by Black+Parrot · · Score: 5, Funny


      > INTERROGATOR: "I'll ask you once more - Did you kill Mrs. Finkelstein?"

      PRISONER: [God, what a fine set of tits!] "No."

      INTERROGATOR: [Me, or Mrs. Finkelstein?] "We have the evidence."

      --
      Sheesh, evil *and* a jerk. -- Jade
    2. Re:I'll take the Fifth - NOT! by Anonymous Coward · · Score: 5, Funny

      VOTING MACHINE: "Democrat, or Republican?"

      VOTER: "Ummm..."

      VOTING MACHINE: "Republican. *DING* Next voter, please!"

  12. I'm trying the device right now by Larry+David · · Score: 3, Funny

    <<.. wow .. this device feels kinda neat ... ooooh .. tingly on my adenoids there ... i wonder if it's working ... it would be so cool if it did .. i always dreamed of this as a kid .. oh my god being a kid was great .. i wish i could hug my dad again ..>>

    No, these damn things simply DON'T WORK!!

  13. Dating by Mr.+Certainly · · Score: 5, Funny

    Guys, no matter how geeky and nerdy you want to be, NEVER TAKE THIS INVENTION ON A DATE!

    1. Re:Dating by Anonymous Coward · · Score: 4, Funny

      hmm, where is she... ah, wow, looks almost as good as her picture. kinda shorter than i throught. good rack, though, for an asian girl. too bad about that tummy. oh well, i'd hit it. i hope she doesn't notice the stain on my tie. man, she looks kinda pissed off. oh shit, she's leaving. fuck, there she goes. goddamnit, i totally coulda nailed that one, too. i guess i'll be downloading porn tonight. great, now everyone is staring at me. fucking assholes, never seen a stained tie before?

  14. Useful if it works... by Kulic · · Score: 5, Interesting

    but it'll probably be years before we see it commercially.

    Imagine using voice commands to control your computer remotely - you're on a croweded bus, using your cell phone to connect to your house computer, telling it subvocally to turn on the airconditioning in time for when you get home, to turn on the coffee maker and download some work from the office and a movie for later. And no one hears anything, and the only thing they can see moving is your throat. What about dictating a letter on your way home, or other documents?

    What about secret service agents? Or the military? No more needing to talk into their sleeves or using noisy radio to give away their position. You could have the conversation turn up on a pda screen, or have an artifical voice piped into ear phones. How cool would that be?

    I'm sure there's lots more stuff you could use this for that I haven't even thought of yet, but I'm betting it is still years away.

  15. Better start practicing by Facekhan · · Score: 3, Interesting

    Better start practicing singing a song in your head to block out the thought police. "Mary had a little lamb, little lamb, little lamb, Mary had a little lamb its fleece was white as snow..."

    1. Re:Better start practicing by subtropolis · · Score: 3, Insightful

      Daisy, Daisy, give me your answer do...

      --
      "Our interests are to see if we can't scale it up to something more exciting," he said.
  16. I don't like this by r_j_prahad · · Score: 4, Funny

    "Good morning, boss (you clueless moron). What (boring and useless) work have we (pitiful understaffed few) got on the agenda for today (and the rest or our meaningless lives)?"

    "I'm not feeling well (I need a beer to numb my brain after working for you all day). Can I go home (pub crawling) early?"

  17. Interesting uses... by Eric_Cartman_South_P · · Score: 5, Interesting
    Navy Seals on a mission: great way to communicate to each other in stealth.

    Sports cheating: communicate perfectly to coach when you are not supposed to.

    Croc Hunter: sneak up on animals in the wild to research, etc, and communicate with team and not startle animals.

    Porn: somehow... someway...

    Government: give tech 20 more years and when these signals can be picked up remotely, let FBI tap the signals without a court order because, hey, there is a War On Terror(TM) to fight.

    Interrorgation: capture truth someone would have wanted/started to say but then held their tounge at the last second.

    Slashdot: this tech + reconition to text + scripting = best chance at first post. Just think about BSD dying, and it's dead!

  18. A couple implications by Schlemphfer · · Score: 5, Interesting
    There are times when we think in complete sentences, and times when we just rely on non-verbal thinking. Generally, the more planned the act, the more likely that complete sentences pass through your brain.

    For instance, you're more likely to simply pick a quarter off the floor than to say, "I am going to pick this quarter off the floor." Whereas, you're very likely to think the sentence, "I should buy some wine on my way home from the market" if that's part of your plans.

    Seems to me that this technology could, in short order, discern the verbal sentences we fashion for ourselves as part of our daily thinking. But it won't ever pick up on the million thoughts we have each day that aren't based on words.

    If this technology gets deployed, society will have to learn in short order that not every thought is legitimate. My verbalizing the thought to myself, "I am Napoleon" does not necessarily mean that I think I am Napoleon.

    One last thought. If we get widespread, cheap deployment of this technology, it will have as big an effect on our lives as the World Wide Web.

    --
    I'm generally "Interesting," "Insightful," and even "Funny" here. What the hell happens to me at parties?
    1. Re:A couple implications by zelyan · · Score: 3, Interesting

      Which of course brings up the question

      Who's going to have the first 24/7 subvocal weblog?

      Who, extending the webcams, is willing to put every single thought they have, enough to subvocalize, out onto the web?

      SubvocalJenny

      Jeff

  19. The titel got it right : Words not yet spoken by TekGoNos · · Score: 3, Informative

    Most (all?) people actually "speak" when they think in words. This is most observable while reading.

    When you think (or read) "banana" your brain creates the same signals (but at lower magnitude) as if you would say it. Your tongue actually moves while your reading. Experiments with mute people have shown that they actually move their hands slightly, as if they were forming the words, they read, in sign-language.

    This technology does not read your thoughts, but the signals send to your vocal system. As it catches the signals before they reach the vocal system, it reads "words not yet spoken". If you speak the words or just think them doesnt mattern the system. However, the system doesnt reads your thougths. If you just imagine a banana, but do not think the word "banana", the technology wouldnt catch it (even if improved), as imaging a banana doesnt trigger a signal to the vocal system.

    --
    I have discovered a truly remarkable proof for my post which this sig is too small to contain.
  20. cellular phones ! by S3D · · Score: 5, Interesting

    At last I will not have to hear four persons shouting in their phones just around my pen in the open space. And there will not be those mad-looking people talking into the empty space on the street. On the other side, someone who talk other the phone a lot may forget actually produce sounds while talking with somebody nearby.

  21. Hey morons - read the words that are printed.. by zytheran · · Score: 4, Informative

    .. not what you think is printed before your eyes get around to reading it.

    "A person using the subvocal system thinks of phrases and talks to himself so quietly it cannot be heard, but the tongue and vocal cords do receive speech signals from the brain,"

    Notice the phrase "..talks to himself so quietly.."?
    This is NOT the same as "thinks to himself"

    i.e.you mouth the words but don't blow air through your airway so no noise is made.

    it's not friggin' mind reading..unlike most of the level 5 posts seem to think.

    1. Re:Hey morons - read the words that are printed.. by asoap · · Score: 3, Informative

      Ugh, dude...

      You might want to read the article again.

      "Biological signals arise when reading or speaking to oneself with or without actual lip or facial movement."

      Notice the part that says "without actual lip or facial movement"? So we have, "talking to yourself", and "no lip or facial movement". That sounds a lot like "thinking to yourself" to me.

      -asoap

      --
      Treat me like a marketing stat, and I'll treat your movie like a series of ones and zeros
  22. Seen this before by Snafoo · · Score: 4, Insightful

    As another poster mentioned, in OSC's Ender novels, as well as in David Brin's _Earth_. As a matter of fact, the latter described the device almost precisely as described here. Brin even thought of some important caveats: given how difficult it is for the average human being to keep their thoughts on track for 0.2ms, the thing is almost impossible to use for more than 0.3ms. (The extra 0.1ms is the length of time it takes to think 'FORKING PIECE OF SHI.zza!@EOF' as you reach for the sensors.)

    So don't get too excited, all you ADD, quasi-ADD and just plain procrastinatory slashdotters -- whoever ends up using this tech won't be you. :)

    --
    - undoware.ca
  23. More Practical Uses by Grip3n · · Score: 3, Interesting

    Anyone else here feel that getting those words not yet spoken would be an absolute breakthrough in relationships with their girlfriends? Man that would have saved my butt countless times...

    --
    To make a pun demonstrates the highest understanding of a language
  24. Old news by Underholdning · · Score: 5, Funny

    I've had a device that could detect (and react) to words I haven't even spoken yet, for years now. I call the device "wife".

  25. Re:No real difference by gantrep · · Score: 5, Informative

    The way I see it, there are three kinds of silent reading.

    The first involves real subvocalization, meaning people that read out loud very quietly and move their lips. I don't want to offend anyone, but I find it kind of annoying when people do that. Don't know why. The number of people that do this is in my experience, a minority and occurs most often in people that are weak readers or intentionally reading very carefully. I actually will do it myself when I am following chemistry lab instructions or sometimes when I read in Spanish, a second language.

    The next kind of reading is what I think is the most common. There is no subvocalization of any kind, no tongue moving inside the mouth, no vocal chord movement, but words written are mentally translated first to sound-thought and then comprehended. I'm not sure if sound-thought makes sense but it's the best description I can think of. Sound-thought is then what is actually processed and understood by the brain. This I think is most common because I believe that most people's thought process takes the form of an internal monologue. A notable exception is that I know when I do calculus, there is a lot of visualization, algebra, logic and simple math going on in my head and very little verbal thought.

    The last kind of reading I think could be considered a form of speed-reading, though I have never taken any speed-reading instruction. I use this whenever I am not reading for pleasure and the passage need not be read super-carefully. I look at the words very quickly and directly process them without first converting to internal sound-thought. If the passage is divided into narrow columns, I can process a whole line at a time and scan straight down the page without any lateral eye-movement.

    The level of comprehension and retention when I do this is worse than with methods one or two, but it's extremely fast. The biggest advantage for me anyway that it has over methods one and two is that I retain parts of the text visually. I have a quasi-photographic memory and when I took a course in US History for example, I was able to read names and dates off pages in visual memory because I read the text in that manner.

    Now, to get a little more back on topic....

    When I was in high school, I competed in quiz bowl trivia competitions like jeopardy, but the questions are only read aloud, and you can buzz in and interrupt the reader at any time before the question is finished and give an answer. Our team and other very good teams learned ways to anticipate the question.

    Some teams' familiarity with the subtle structure and format of the questions gave them such a strong intuition that weak teams would swear they were cheating. You got to know individual readers and how much they will continue to read after you buzz in(sometimes finishing the word, sometimes mid-syllable.) Which brings me to my point; if you watch somebody's mouth very carefully when they speak, as they are ending a word and starting to form the next, it's easy to tell what the next letter out of their mouth will be.

    A teammate of mine once rang in after a reader had read the letter "J" and then stopped. He could tell the next letter was going to be D, and there had already been several similar questions in earlier rounds asking for different information concerning the same subject that he could tell pretty certainly what the question was going to ask(questions often repeat subject but rarely answers between rounds) So he answered Holden Caulfield.

    The other team wasn't pleased at all.

    This skill could be practical in interrogations of criminal/terrorist suspects and is what I first thought of when I read the headline of the story. (A better headline would be Nasa develops computer processing of subvocal speech.) A suspect under a lot of stress may come close enough to giving you a name that you can tell from the shape of their mouth that it probably starts with an L rather than a T before refusing to speak any more, and that might be enough.

  26. Solution for mute people ? by master_p · · Score: 4, Interesting

    Could it be used for people that have their vocal cords destroyed ?

  27. Every subject they tested ... by WebMasterJoe · · Score: 4, Funny
    Transcript of the thoughts of everyone they tested:
    He doesn't know what I'm thinking.
    ...
    Ok, that was a lucky guess.
    So was that.
    And that.
    Whoa, this is getting weird.
    --
    I really hate signatures, but go to my website.
  28. Who do you want to be today? by fygment · · Score: 3, Insightful

    Simply take a vocal sample of the person of interest. Now think your words and with a little quick signal processing out comes the voice of the person of interest speaking your words. Fun at parties and for police mounting "sting" operations. Possibly could render recorded conversations inadmissible as evidence.

    --
    "Consensus" in science is _always_ a political construct.
  29. Oh god, the cheating by Iowaguy · · Score: 3, Interesting

    As an educator, I see a nightmare if this technology goes mainstream. Kids will send messages through calculators, which is bad enough. How the hell would you stop this?

    -Iowa

    --
    "He who laughs last, didn't get the joke."-Cap