Slashdot Mirror


Researchers Convert Mouth Movements Into Speech

andylim writes "According to Cellular News, researchers at Germany's Karlsruhe Institute of Technology have developed a method for mobile phones to convert silent mouth movements into speech. As recombu.com points out, the 'potential for secret conversations just got huge.' You could pass the time by making phone calls from the cinema without disturbing anyone. In noisy places like bars and clubs you could make yourself heard without having to shout."

19 of 154 comments (clear)

  1. tap-proof? by bwindle2 · · Score: 5, Insightful

    From TFA: "For the transmission of passwords and PINs, for example, users can change seamlessly to soundless language and, hence, transmit confidential information in a tap-proof manner." Um, not if there is a lip-reader in the same room, like a hearing-impaired person.

    1. Re:tap-proof? by Dice · · Score: 4, Interesting

      According to my ASL instructor, lip readers are rarely more than 50% accurate. Which makes me wonder about the alleged capabilities of this software, honestly.

    2. Re:tap-proof? by ScrewMaster · · Score: 3, Informative

      According to my ASL instructor, lip readers are rarely more than 50% accurate. Which makes me wonder about the alleged capabilities of this software, honestly.

      Hard to say. However, if you want true speaker-independent language recognition ... well, even using voice it's only so-so. On the other hand, if what you want is the ability to issue commands to the computer using a much more limited vocabulary, I'd think you'd have more potential.

      --
      The higher the technology, the sharper that two-edged sword.
    3. Re:tap-proof? by techno-vampire · · Score: 3, Interesting

      I have some hearing loss, and went to a seminar at the VA once about adapting. I don't know how good lip readers get, but for me, at least, it's mostly useful if I have an idea what's being said and just need to fill in bits that I didn't quite catch. I suspect that this will need at least some training with the user, just like voice recognition software does, and that it's going to be a long time before it's good with anything but a very limited vocabulary.

      --
      Good, inexpensive web hosting
  2. Ok, try this one by Brett+Buck · · Score: 3, Funny

    I said VACUUM!

  3. It begins by Quackers_McDuck · · Score: 5, Insightful

    Dave Bowman: Hello, HAL. Do you read me, HAL?
    HAL: Affirmative, Dave. I read you.
    Dave Bowman: Open the pod bay doors, HAL.
    HAL: I'm sorry, Dave. I'm afraid I can't do that.
    Dave Bowman: What's the problem?
    HAL: I think you know what the problem is just as well as I do.
    Dave Bowman: What are you talking about, HAL?
    HAL: This mission is too important for me to allow you to jeopardize it.
    Dave Bowman: I don't know what you're talking about, HAL.
    HAL: I know that you and Frank were planning to disconnect me, and I'm afraid that's something I cannot allow to happen.
    Dave Bowman: Where the hell'd you get that idea, HAL?
    HAL: Dave, although you took very thorough precautions in the pod against my hearing you, I could see your lips move.
    Dave Bowman: Alright, HAL. I'll go in through the emergency airlock.
    HAL: Without your space helmet, Dave, you're going to find that rather difficult.
    Dave Bowman: HAL, I won't argue with you anymore. Open the doors.
    HAL: Dave, this conversation can serve no purpose anymore. Goodbye.

    1. Re:It begins by MichaelSmith · · Score: 3, Funny

      HAL: Without your space helmet, Dave, you're going to find that rather difficult.

      Best musical comedy ever.

  4. I'm coulrophobic, you insentive clod! by zill · · Score: 4, Insightful

    It's been almost a decade since hands-free headsets reached the market and its users still creep me out.

    I don't think I can ever get used to seeing the streets full of mimes.

  5. I wasn't buying it ... by GNUALMAFUERTE · · Score: 4, Insightful

    And I was just waiting for that sign, well hidden somewhere in the article, that this is just some beta concept that will stay as such forever.

    And then I found the photo of two guys with shitloads of cables attached to their faces.

    There's a huge difference between "cellphones convert mouth movements into speech" and "Guy with shitloads of cables on his face tracks the movements of his mouth muscles using 4 unix servers running a processor intensive application with an accuracy of 25%"

    The whole thing has nothing to do with cellphones. It's just yet another muscle tracking system, but used on the mouth instead of the hands, and tied to a TTS engine.

    --
    WTF am I doing replying to an AC at 5 A.M on a Friday night?
    1. Re:I wasn't buying it ... by Corporate+Drone · · Score: 3, Insightful

      And I was just waiting for that sign, well hidden somewhere in the article, that this is just some beta concept that will stay as such forever.

      And then I found the photo of two guys with shitloads of cables attached to their faces.

      There's a huge difference between "cellphones convert mouth movements into speech" and "Guy with shitloads of cables on his face tracks the movements of his mouth muscles using 4 unix servers running a processor intensive application with an accuracy of 25%"

      Yeah, you're right. We've never gone from a situation where we've had shitloads of hardware and cables, and been able to reduce that down to mobile devices. What were those researchers thinking? Dolts!

      (p.s., can you give a link to the "shitloads of face cables" story? Thanks!)

      --
      mmm... yeah... You see, we're putting the cover sheets on all TPS reports now before they go out...
  6. Psssshhhttt. Losers. by The+Wild+Norseman · · Score: 4, Interesting

    Any serious geek has one of these.

    --
    "A government is a body of people usually -- notably -- ungoverned." -Shepherd Book
  7. Re:I want my phone call by zill · · Score: 3, Insightful

    The Agent obviously knew about this device already. That's why he removed Neo's lips entirely.

    The machines are always one step ahead of us.

  8. Cinema? by Barny · · Score: 5, Insightful

    You could pass the time by making phone calls from the cinema without disturbing anyone

    No, never and fuck off come to mind. Using a mobile phone in a cinema is one of the least considerate things anyone can do, they create light pollution distracting other patrons from what they are paying for and are absolutely not needed (the exception, emergency staff on call, and they usually just leave their phone on vibrate + silent) let alone any audible noise from them, can't you seriously just disconnect for an hour?

    In short, No.

    In long, Nooooooooooooooooooooooooo-ooooooooooooooooooooooooooooooooooo-oooooooooooooooooooooooo :)

    Also in USA at least its illegal (federal law) to operate any video recording device in a cinema.

    yes, blatant ZP rip-off but its needed.

    --
    ...
    /me sighs
  9. Old grade school trick... by HockeyPuck · · Score: 4, Funny

    I seem to recall that mouthing "vacuum" and "f*ck you" look the same.... ah the joys of being 10...

     

    1. Re:Old grade school trick... by evil_aar0n · · Score: 3, Interesting

      I had to lip-read for 13 years before I got my cochlear implant. If we were talking about such things as vacuums, I'd probably understand what you were saying. If it were just out of the blue, though, yeah, I might misunderstand and punch you for it. In fact, it was considered great fun to say things to me and have me repeat them as I understood them. "Pear pimples for hairy fishnuts?" Stuff like that.

      --
      Truth, Justice. Or the American Way.
  10. I Can Hear It Now by The+Wild+Norseman · · Score: 4, Funny



    Can you steer me how?

    Can you beer me cow?

    Clan ewe fear be now?

    </Stephen Hawking Voice>

    --
    "A government is a body of people usually -- notably -- ungoverned." -Shepherd Book
  11. Re:non german/american performance? by deniable · · Score: 4, Interesting

    Try it with older people from the bush. They speak without opening their mouth to keep the flies out. Some move the lips but keep the teeth together.

  12. 15 years ago, with desktop workstations by BoydWaters · · Score: 5, Interesting

    Fifteen (!) years ago, I took a UC Extension class on Neural Networks taught by Stanford professor David Stork. He had developed a lip-reading system for communication in noisy environments, such as an airplane-repair facility. If you could do it 15 years ago with workstation-class desktops, I suppose you could do it with a smartphone today.

  13. Passing the time? by Anonymous Coward · · Score: 3, Insightful

    You could pass the time by making phone calls from the cinema

    I've always thought that the best way to pass the time in a cinema is to watch the fucking movie.