Slashdot Mirror


Project-Natal-Style Interface For Mobile Phones

An anonymous reader writes "The University of Tokyo is developing a Project-Natal-style interface for mobile phones, which allows you to interact with a phone by waving your finger around. Members of the Ishikawa-Komuro Lab have used a high-frame-rate camera to track the motion of a finger and recognise input gestures. The touchless interface can be used to navigate around a phone's screen and even to type."

49 comments

  1. I foresee problems. by wpanderson · · Score: 3, Funny

    The danger for users of porn is clear and present.

    --
    neuro at well dot com (when I post, it's my opinions, no-one elses)
    1. Re:I foresee problems. by Thanshin · · Score: 1

      The danger for users of porn is clear and present.

      The misdetection of fingers?

    2. Re:I foresee problems. by need4mospd · · Score: 1

      I say it's more translucent than clear. It's not quite present either, but you could say it's coming soon....

    3. Re:I foresee problems. by davester666 · · Score: 2, Funny

      That is NOT a FINGER!

      --
      Sleep your way to a whiter smile...date a dentist!
  2. Air-Typing? No thanks by Anonymous Coward · · Score: 0

    I can barely type well with an onscreen keyboard, and soon they'll want me to air-type? No thanks.

    1. Re:Air-Typing? No thanks by psnyder · · Score: 2, Insightful

      The cool, practical implications for hand-held devices start coming to mind if this is combined with a touch screen.

      (The camera would also need to be less obtrusive, and able to detect fingers just above the touch screen.)

    2. Re:Air-Typing? No thanks by CarpetShark · · Score: 1

      I want a mobile with a laser projected keyboard, and a light-protected screen. With the normal screen and touchscreen keyboard as a backup when there are no good surfaces around, of course. Seems the most obvious (and cool) way to get the necessarily large IO devices "into" a small form factor.

      I haven't actually tried a laser keyboard though. Anyone know if they're actually usable for serious work?

  3. Wow, that's stupid by drinkypoo · · Score: 4, Interesting

    I can understand the appeal of Natal because it lets four people interact with a piece of hardware without holding anything. But if you already have to hold the phone, it seems more than a bit ridiculous to be finding ways to not touch it with your other hand. It's like finding a way to chew your food without it touching your tongue...

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    1. Re:Wow, that's stupid by purpledinoz · · Score: 0, Troll

      Why is this stupid? This is just a cool demonstration of the results of research done at a University. You just lack creativity and imagination to see any use for this. The applications for these types of technologies are not yet explored, so I'm sure we might see some really cool applications for this.

    2. Re:Wow, that's stupid by TheGeekologist · · Score: 1

      This is just like a super alpha prototype. You need to stop thinking about the uses it has now, and more in the uses its going to have later on. Maybe in the future you won't be holding a piece of thick hardware, instead, some ultra nano hardware built-in on an advanced OLED-type screen. I can definitely see the use on something like that.

        I don't know man, just be imaginative.

    3. Re:Wow, that's stupid by Anonymous Coward · · Score: 1, Insightful

      It let's you easily draw in 3D space. Tell me of another interface which lets you do that easily.

    4. Re:Wow, that's stupid by gman003 · · Score: 1

      And how often do you do any 3d interaction on your main computer, let alone your cell phone?

    5. Re:Wow, that's stupid by Hognoxious · · Score: 1

      Why is this stupid?

      Because it's a solution to a problem that isn't actually a problem.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    6. Re:Wow, that's stupid by delinear · · Score: 1

      The first thing that came to mind for me - those touch-screens in public places, like for booking train tickets, or even pub trivia games or cash machines. Maybe I'm overly prone to OCD, but I shudder to have to touch those, not knowing who has used them before me. They're generally smeared with other people's greasy finger marks. If I could air type just in front of the device, I'd feel a lot better. Maybe an alternative would be allowing us to shrink netbooks and laptops by effectively turning the whole of the keyboard area into a big trackpad when your hand is hoverwing over it, and eliminating the UI nightmare of trying to integrate a pad and keyboard while minimising space. I agree on a phone it's difficult to see the point right now, but the research in general is certainly not a waste of time.

    7. Re:Wow, that's stupid by 19thNervousBreakdown · · Score: 2, Interesting

      How often did people fly before airplanes?

      --
      <xml><I><am><so><damn>Web 2.0</damn></so></am></I></xml>
    8. Re:Wow, that's stupid by Hognoxious · · Score: 1

      Quite often, but landing wasn't much fun.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    9. Re:Wow, that's stupid by GrumblyStuff · · Score: 1

      Well... there were balloons.

    10. Re:Wow, that's stupid by The+End+Of+Days · · Score: 1

      It's stupid because Slashdot is populated with basement geniuses who know everything. This is why everything invented is obvious and simple to implement, yet useless.

  4. Hacking.. by skgrey · · Score: 1

    The implications on security in regards to hacking are interesting - you could in theory try to brute-force someone's phone from a slight distance, say next to them on a city bus. Not having to leave fingerprints on someone's device as well is another positive, as it is based on gestures. Especially handy for devices where wireless is protected or not enabled! Even if it took a picture to see who was gesturing, I'm sure you could get out of the way and just have your hand in the frame.

    1. Re:Hacking.. by purpledinoz · · Score: 1

      Security is completely irrelevant to this story. This is just a really cool prototype of being able gesture 3D input. No one is suggesting that you type your passwords purely with gestures.

    2. Re:Hacking.. by Anonymous Coward · · Score: 0

      If a six-figure-a-year executive is stupid enough to fall asleep on public transit with her phone face up on her lap then she deserves to be hacked.

    3. Re:Hacking.. by Jurily · · Score: 1

      executive is stupid enough [...] she

      When was the last time you've seen a stupid female executive?

    4. Re:Hacking.. by ViViDboarder · · Score: 2, Insightful

      Most of the time you have to wake a device before you can do any input. That would probably involve hitting a physical button.

      As for brute forcing... You must be fluent in sign language or something. It's not plausible that if someone was using this to detect some kind of pattern on a device that you'd be able to sneak your little hands over there and try every possible combination in 3D. This detects depth too. So it's not going to be something like Android lockscreens where you slide Left, Left, Right, Up, Right, Down or something. You'll have Up, Down, Left, Right, Front, Back all as possibilities. It would take a very long time to "brute force" with your fingers.

      Also, the device is limited to a fairly short usage distance as well. The contrast between a hand 5 feet away will probably too small to allow the software to define a good finger outline when switched to Black and White. You'll notice that the camera is surrounded with really bright LED's to ensure that, at a short distance at least, the finger is distinguishable.

      So essentially, there is no more security flaw to this as there is any practical reason to use it on a phone. :p

  5. I could probably get used to it, but... by IndustrialComplex · · Score: 4, Insightful

    I guess I understand some of the 'neato' factor that this could have, but isn't one of the big issues introduced with simple touchscreens the LACK of haptic feedback?

    I love my iphone, but I miss being able to just reach into my pocket and dial a call, or skip a song/rewind, etc. Having to pull my phone out every time I want to do anything other than change the volume is damned annoying.

    I could just see this kind of interface being more annoying to use.

    --
    Out of modpoints but really liked a post? 1BDkF6TtmmeZ3yqXbz9yhdYVqRYnwFoXDj
    1. Re:I could probably get used to it, but... by vivaoporto · · Score: 1

      I love my iphone, but I miss being able to just reach into my pocket and dial a call, or skip a song/rewind, etc. Having to pull my phone out every time I want to do anything other than change the volume is damned annoying.

      If you are using the default iPhone earbuds, you can do all that using the middle button (the one between the up and down volume buttons):

      One click to play/pause, two clicks to skip to next, three clicks to go back to previous, click and hold to activate Voice Control (where you can make calls, play albums, playlists, etc.).

      That is a life saver feature that should be more publicized, took me a while to figure them out.

    2. Re:I could probably get used to it, but... by IndustrialComplex · · Score: 1

      I didn't know about Voice Control, does it require any special apps or iPhone version (3gs?)

      Also, is there a non-apple version of earbuds available with those buttons? I'd use mine, but they don't fit my ear well and let in a lot of ambient noise. I've just been using some nice earbuds (no buttons) that give a good seal.

      --
      Out of modpoints but really liked a post? 1BDkF6TtmmeZ3yqXbz9yhdYVqRYnwFoXDj
    3. Re:I could probably get used to it, but... by Thing+1 · · Score: 1

      Thank you.

      --
      I feel fantastic, and I'm still alive.
  6. Wow, now that is COOL! by purpledinoz · · Score: 1

    I was really impressed by the smoothness and accuracy that the camera was able to track the finger movements. Usually, things like this are really jumpy and horribly inaccurate. Although it's not the best way to type things in, I'm sure there will be a ton of cool applications of this.

  7. In Japan it could make more than enough sense... by sznupi · · Score: 1

    ...if all those flamboyant choreographies from anime are any indication.

    --
    One that hath name thou can not otter
  8. Public interface by need4mospd · · Score: 5, Insightful

    This would be pretty cool to slap into some public use areas like train stations, airports, movies, etc... Half the touchscreens I've used in public areas are always broken(or half working) after a couple years from people pounding on the screen when it won't respond. Slap a piece of plexiglass in front of it that you can replace when it gets damaged, saves the expense of a whole new touchscreen.

    1. Re:Public interface by Saint+Gerbil · · Score: 1

      And then comes the law suits when someone inevitably slaps a passer-by while trying to find their way to ann-summers.

  9. Reminds me of by Anonymous Coward · · Score: 0
  10. In Other News: Apple sues the University of Tokyo by TheGeekologist · · Score: 1

    For stepping on some of their zillion iPhone patents.

  11. Hope for Mankind by NEDHead · · Score: 0

    I was watching the demo video, and all of a sudden my finger started moving around matching what was on the screen! Then I realized that at last we have a glimmer of hope for a future where our politicians actually do what we want them to do....

  12. Great... by fragMasterFlash · · Score: 1

    We already have enough Bluetooth headset users walking around giving the appearance that they are talking to themselves. Now these same people are going to look like they are having their solo discussions in sign language.

  13. Less accurate by Enderandrew · · Score: 1

    The iPhone 4 prototype that leaked has second camera that faces the user. It could go gesture recognition as well. However, the last thing I want is a less accurate means to control my phone. Why wave my fingers in front of the phone, when I could just extend my fingers slightly more and touch the screen?

    --
    http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
    1. Re:Less accurate by Saint+Gerbil · · Score: 1

      I'd have thought this would be the style over function stuff apple would normally jump at.

  14. Natal? by Anonymous Coward · · Score: 0

    Stop calling it "Project-Natal-style", because as usual Microsoft didn't invent anything.

    Call it "EyeToy-style", as it should be.

    1. Re:Natal? by Anonymous Coward · · Score: 0

      There is significantly more to Natal than the Eyetoy part: it tracks multiple actors (more-or-less the moral equivalent of "multitouch" eyetoy), tracks in 3 dimensions, voice recognition, natural language processing, facial/object recognition, etc.. The eyetoy was not really sufficient for a full on natural interface. Calling it "Eyetoy-style" is like saying your new HTC Dream has a button-style interface, since you can press the screen. Or that a truck has a walking-style interface because you use your feet to move it. When in fact a truck's interface might better be compared to a car, or the HTC Dream has an iPhone-style interface. There's just a huge gap beyond one obvious similarity.

      Plus, it's not like the Eyetoy was the first thing to recognize images on even a 2D plane anymore than Natal would be.

    2. Re:Natal? by Anonymous Coward · · Score: 0

      Well, okay then. But can we agree that "Natal" sounds as dumb as "Zune"? Seriously, what's wrong with the marketing department at Microsoft? They used to be the best ones out there.

    3. Re:Natal? by IrquiM · · Score: 1

      Are you telling me that my multiplayer eyetoy games doesn't work? That Eyetoy Pet doesn't work? What are you trying to say?

      --
      This is blinging
  15. Customized settings? by tillerman35 · · Score: 2, Funny

    So, can I assign "thrust middle finger into air" to the speed dial for my ex wife?

  16. Natal Style? by Anonymous Coward · · Score: 0

    It's a single camera, not stereo cameras. It's nothing like Natal. It's more like the Playstation Eye, which predates Natal by a decade.

  17. Natal Is Garbage by Anonymous Coward · · Score: 0

    LOL! Are you a fucking moron.

    Every showing of Microsoft's shitty EyeToy ripoff has shown it to be a laggy, glitchy turd of a technology.

    It was so bad last E3 Microsoft was caught faking their demos of it by the gaming press.

  18. Natal hasn't even launched... by sherriw · · Score: 1

    Considering that Natal hasn't even launched yet, other groups might want to hold off and see what the reception is to Natal before they start copying it. I for one bought a Wii and was sorely disappointed in the non-precision of the wii-mote. I also have an Xbox and I fear that Natal will be just as annoying. I hope some cool uses of it are created though.

  19. Sign language by Anonymous Coward · · Score: 0

    how is it the first thought is for faster interaction to a mobile device and not for helping handicapped people to communicate with the world.

    Seems a shame we look at new technologies with helping ourselves, rather then helping others.

  20. The Question of the Future by medcalf · · Score: 1

    Are you making a phone call or miming being stuck in a box?

    --
    -- Two men say they're Jesus. One of them must be wrong. - Dire Straits
  21. How about parsing ASL? Or finger-spelling. by Ungrounded+Lightning · · Score: 1

    I can barely type well with an onscreen keyboard, and soon they'll want me to air-type? No thanks.

    How about parsing ASL (American Sign Language)?

    Then again, finger spelling might be easer - since that only involves one hand, rather than both and the body, letting you hold the phone in the other and reducing the camera requiremens. Also a much more limited "vocabulary" consisting mainly of the letters and numbers.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  22. An obvious use: larger keyboard by robi5 · · Score: 1

    For those asking how it is an improvement over a touchscreen: There can be a ratio of finger movement vs. cursor movement, that is, a mid-air keyboard can be made much larger than an on-screen keyboard.