Slashdot Mirror


Talk ... Without Speaking

mjm7 writes "Finally, we might be able to get rid of all those annoying people yelling over the static on their cell phones! CNN has an article about a new technology that senses muscle movements in your face and then translates them into sound. This way all you have to do is mouth words into the phone...not actually speak!" Somehow I suspect that we'd lose a lot of the subtleties of communication, but it sure would be nice every time hemos calls me from the discotheque.

31 of 275 comments (clear)

  1. Hyperion by PinkStainlessTail · · Score: 3, Insightful
    Reminds me of the subvocal systems used in this series (as well as tons of other sci-fi). We're slowly catching up to the imaginary future!

    --
    "Slashdot is about legos and staplers." -Cmdr. Taco
    1. Re:Hyperion by Jouster · · Score: 3, Interesting

      I would be very surprised if they can successfully and consistently measure the movements that result in diphthongs, as the muscle movements involved are extremely minimal.

      Diphthongs, by the way, are why interfaces that attempt to "read lips" without the benefit of a phonetic dictionary of some kind (and preferably a context one as well) always fail miserably, to the eternal chagrin of the CIA.

      Jouster

  2. Anderson by swordboy · · Score: 5, Funny

    The Anderson partner called his secretary on his cell phone and said:

    Ship the Enron documents to the Feds

    But she heard:

    Rip the Enron documents to shreds

    It turns out that this was all just a case of bad cellular...

    --

    Life is the leading cause of death in America.
    1. Re:Anderson by Mwongozi · · Score: 3, Insightful

      Mr. Smith is now office head.

      Mr. Smith is now off his head.

      Spot the difference. :)

  3. finally! by Joe+the+Lesser · · Score: 5, Funny

    We'll finally be able to understand what the hell mimes are doing! Rejoice!

    --
    "I only speak the truth"
    Karma: null(Mostly affected by an unassigned variable)
  4. The mute and deaf by spookysuicide · · Score: 5, Insightful

    Imagine what a world of difference this would make to the mute or to people who had lost the use of their voice due to throat cancer. It seems weird they didn't mention the applications this would have for people who have lost or have never had the use of their voice.

    --
    yes i run a goth/punk/emo porn site.
    1. Re:The mute and deaf by iabervon · · Score: 3, Interesting

      Actually, that's old news. This is very similar to Tatama, which used to be used by people who were both deaf and blind to; the speaker would speak normally (in English), and the "listener" would feel what the person was saying with fingers on the side of the person's face and in front of the person's mouth.

  5. Olive Juice by looseBits · · Score: 3, Funny

    Words like this may cause some minor misunderstandings.

    --
    Lord, bless my users that they may stop being such fucking idiots!!
  6. injured vocal chords by CmdrTaco+(editor) · · Score: 4, Insightful
    I realize people may think of this as a luxury, but there are many people that don't have the ability to speak. From crippling diseases to the negative effects of a lifetime of smoking, some people simply cannot use their vocal chords. I know I'd find his handy next time I'm sick with a sore throat!

    I'd also have to say this should be made mandatory for all people that would otherwise force me to listen to their loud cell phone conversations.

    1. Re:injured vocal chords by NanoGator · · Score: 3, Funny

      "From crippling diseases to the negative effects of a lifetime of smoking, some people simply cannot use their vocal chords."

      For some reason, this sentence conjured up a picture in my mind of Steven Hawking sounding a bit like a furby on the phone.

      --
      "Derp de derp."
  7. Speech recognition software! by WinPimp2K · · Score: 3, Interesting

    Yeah, this sounds like just the thing for people who want voice dictation, but work in a "noisy" environment.
    Alternatively, you could even have a microphone attached so that when you actually did speak, it would automatically disable the recognition - no more accidentally transcribing your half of a phone conversation for example. Wait a minute, I have to patent that idea! :-)

    --

    You either believe in rational thought or you don't
  8. I doubt this will ever work... by TheNecromancer · · Score: 4, Interesting

    Think about it, don't most people move the muscles in their mouths slightly different when they are mouthing words, as opposed to actually speaking them? I would venture that the technology wouldn't be able to discern the subleties in the way we speak.

    Other than that, it sounds like an interesting technology.

    --
    Attention all planets of the Solar Federation! We have assumed control! - Neil Peart
    1. Re:I doubt this will ever work... by Linux+Ate+My+Dog! · · Score: 4, Interesting

      If the box gave feedback, people would very quickly compenstate to insert subtelty back and modulate the output just like they want to have it. The speech system is amazing that way, as you prove every time you manage to stay completly intelligible when speaking while chewing.

      When I once asked a linguist friend about this on an unrelated topic, he leaned over the table and put his thumb and index finger on the outer corners of my lower lip, and then pinched them together to immobilize it. "Speak," he said. It was wierd but I sounded near normal in less than three words.

      We adapt.

  9. Feelings in Haiku form... by MonkeyBot · · Score: 5, Funny

    Talking on my phone
    I twitch, about to sneeze hard.
    Phone thinks I said "F*CK."

  10. for the 20 and under crowd... by Hadlock · · Score: 3, Funny

    does anyone remember the "my teacher is an alien!! series? plot synopsis: 4th grader finds out teacher is an alien (suprise, suprise), teacher/alien sees him seeing him, and keeping glactic security safe, takes him up into the New Jersey (mega-big spaceship), and they cruise about, saving the universe.

    anywho, i read (and probably own) the whole series in probably 4th grade, i'm 18 1/2 now. on one of their missions, they had special devices like this; except it attached to your throat muscles, which is probably a whole lot easier and less conspicious. the funny part was that they had to whisper, otherwise they'd "yell" right into the other people's earsets. good to know this stuff is comming to fruit

    my teacher is an alien on amazon.com

    the interesting thing about the series, is that it explains in amazingly simple terminology, using a large noodle, how hyperspace works. i'd explain more, but i don't want to get modded offtopic TOO much. and i have to go to work.

    --
    moox. for a new generation.
  11. It's coming... by IdahoEv · · Score: 5, Funny

    "Rotate the pod please, Hal..."

    Dave ... I could see your lips moving ...

    -Ev

    --
    I stole this sig from someone cleverer than me.
  12. Re:William Gibson? by prator · · Score: 3, Informative

    Was that in "The Diamond Age"? I can't remember.

    This was in the Ender's Game series. This is how Ender communicated with Jane.

    -prator

  13. My first thought by mcc · · Score: 4, Interesting

    Is that this would be great for people who for one reason or another no longer have voiceboxes.

    I had a great-aunt who lost a decent portion of her lungs to cancer and cigarettes, and up until her death a few years ago she had to use one of those darth-vader vibration-amplifier things like the "Ned" character does on south park. I was terrified of her when i was six.. (Give me a break, i was six years old and stupid.)

    Anyway, i can imagine that technology like this would be just about perfect for people disabled in a similar manner through tobacco, cigarettes or who knows what. No? At least it would keep such people from having to deal with their idiot six-year-old-nephews reactions to the harsh sounds of the vibration amplifier box..

    and really, even beyond that, tech like this would be just about the only option for people who are going through whatever that intensive vocal-node-therapy thing is where you're banned from speaking for six months. and i know a number of theatrical singers who would be intensely happy to have one of these so that they could rest their voices between performances without cutting themselves off from the world...

    I hope that once this complete, they'll sell a unit where the voice-synth thing outputs into speakers rather than a phone.. I'm sure they would have looked into this possibility by now, right?

    (P.S.: While we're on the subject, sort of.. just in case anyone reading knows: This came up as an argument the other night when we were watching the Oscars and examining how much pain Enye appeared to be in from having to exert her voice. What's the difference between a vocal node and a vocal nodule?

  14. This news must be especially frustrating... by JordanH · · Score: 4, Funny

    to those with Tourette Syndrome.

  15. Hello Darkness my old friend... by istartedi · · Score: 3, Interesting

    Was anybody else immediately reminded of the old Simon and Garfunkel tune, sounds of silence in particular the line about "people talking without speaking" (the link is a poor transcription).

    --
    For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
  16. Would this help my girlfriend? by Mononoke · · Score: 4, Funny
    Could she tell me her day's troubles while kneeled before me with her mouth full?

    (It's just a JOKE! I know I'm not the first to think of it.)

    --
    NetInfo connection failed for server 127.0.0.1/local
    1. Re:Would this help my girlfriend? by r_j_prahad · · Score: 3, Funny

      (ghostly voice heard over the earphone....)

      "Ick, he tastes awful, not pleasant like Jimmy or Bobby or... or... or even Samantha."

      Be satisfied with the funny smile, mate.

  17. You know... by quantaman · · Score: 3, Funny

    Usually when I mouth a word into my phone it usually means I DON'T want the other person to hear it. I'm not sure what the learning curve would be on a device like this but chances are that until person hits it they are going to have a lot of explaining to do!!

    --
    I stole this Sig
  18. mouth movement + sound? by jat2 · · Score: 4, Interesting
    The article seemed to imply that the technology would only use mouth movements, thus allowing the phone to ignore all sound, a lot of which is noise. Of course, as CmdrTaco points out, this could lead to a loss in some of the subtleties of communication.

    Couldn't someone use the movements in addition to the sound to filter out the actual speaker's voice from the background noise? This seems almost like a nonlinear Kalman filter application (though I am by no means an expert on such things), if you had a (presumably nonlinear) model for speech as a function of the movements of the mouth. The article didn't give too much detail. Oh well, it sounds interesting in the very least.

  19. The value of a person's voice by guttentag · · Score: 3, Funny
    ...with the help of a voice synthesizer, mobile-phone users can communicate in silence...
    Synthetic Voice: hi ... rob ... it's linus ... no ... really ... take a look ... at ... the next version ... of the lye nucks kernel ... at ... h ... t... t... p... colon slash slash ... goat ...
  20. Re:This is bad news because... by ziriyab · · Score: 5, Funny
    PhysicsGenius wrote:
    You may not be aware of this or have thought of it this way, but a microwave oven is basically just a big, unmodulated radio station broadcasting in the microwave band instead of the radio band.

    ...and lightbulbs are just microwave ovens broadcasting mainly in the visible range. And where do we put these light bulbs? Everywhere we live!!! Oh my GOD, we're all gonna die of cancer from light bulbs!

    Are you a real physics genius, or do you just play one in front of your liberal arts friends ;)

  21. Not new by doublem · · Score: 3, Informative

    Not new, old technology. They even have a guy who uses a handheld one on South Park!

    --
    "Live Free or Die." Don't like it? Then keep out of the USA
  22. Quantum Leap, Tom and Jerry... by NanoGator · · Score: 3, Interesting

    Anybody ever pay attention to the sounds that the handlink makes on Quantum Leap? For example, it kind of goes 'waaaaahhhh' when he smacks it. That's the most obvious one, but if you listen a little more carefully, the sounds that little device makes start to emote. You can get an idea what he's reading on the screen before he actually states it.

    Tom and Jerry is similar, to a degree. I ran across a cartoon of Tom and Jerry on the web a few days ago and watched it. I noticed something very interesting. The music in the cartoon responded to every little movement that the characters made. You listen to the music, for example, and tell if Jerry was tiptoe'ing or running. That was a very interesting dimension to Tom and Jerry. That is the type of element that would allow you to watch a slideshow of the show with the sound track and still keep track of what's going on.

    This article was very interesting because I think it may be the start of making computer interfaces take advantage of audio responses that don't even require words. I've spent a great deal of time assigning different sounds in Windows to different events. For example, I have a very distinctive sound that ICQ makes when I recieve a message. I even went as far as to provide different people with different sounds. I noticed something very interesting, when I went to use ICQ on another machine, I ached to hear the sounds again. It was so strange not hearing them!

    I hope one day Windows (or whatever OS I use in the future...) spends more effort into providing a sound-enhanced interface. That would truely provide better a better multi-tasking experience. It'd be cool if, for example, the window on the screen causing the sound was played through the right or left speaker based on where the window is on the screen. Maybe muffle it if a window is under it.

    Anybody know of any products for Windows that do this today?

    --
    "Derp de derp."
  23. Just watch what you mouth! by MadCow42 · · Score: 3, Interesting

    Now I can't mouth obscenities about the person I'm talking with without them hearing!!! You can't also hold a "quiet" conversation with the person beside you while "politely" listening to the person on the phone...

    Oh well... my boss probably needs to know about what I call him behind his back anyways. q:]

    MadCow.

    --
    I used to have a sig, but I set it free and it never came back.
  24. Papa Bush... by chinton · · Score: 3, Funny
    "Read my lips.". With this nifty device, we wouldn't have had to read his lips, and we would have heard the (subvocal) last word of his famous quote:

    "Read my lips. No new taxes (today)."

  25. Not a big problem... by wirefarm · · Score: 3, Informative

    ...since the research is being done in Japan.
    Japanese has very few dipthongs.
    A word that might be spelled 'Ao' using latin characters,(Â), would be pronounced as 'Ah-ow' (sort of).
    Some words do change the vowels, but usually just by extending it. The word Tokyo isn't pronounced 'toe-key-o' as much as it is 'to-u-key-o-u'. The audible differences can be very slight, though. Possibly by sensing the muscle movements, it would be easier to discern the differences.
    Another interesting capability would be the ability to discern mood. Consider the following:
    'Yes dear, I'd <rolls_eyes>love</rolls_eyes>to have your mother visit this weekend...'

    I'm not sure that I'd want my phone telling my girlfriend when I'm being sarcastic. You could have a new groupof 'tags' kind of like those you see on IRC:
    roll_eyes
    clench_jaw
    check_watch
    sneer
    cringe
    shake_head_in_disbelief_at_the_studidity_of_what_i s_being_said

    You get the idea...
    Cheers,
    Jim in Tokyo

    --
    -- My Weblog.