Slashdot Mirror


Google Works On Kinect-Like Interface For Android

bizwriter writes "A patent filing made public last week suggests that Google may be trying to implement a motion-detection interface, like Microsoft Kinect, for portable electronic gadgets. The patent application is for technology that turns a mobile device's camera into a motion-input system. In other words, it could be goodbye to fingerprints and streaks on the front of your tablet or smartphone. Google could incorporate such a feature into Android in general or keep it as a differentiating advantage for its acquisition of Motorola."

49 comments

  1. More sales by agentgonzo · · Score: 4, Funny

    I get it. They're following the Wii model:

    Rapid gesticulation to control device
    Accidentally throw device across room
    Have to buy new device to replace broken one
    Profit!

    1. Re:More sales by cpu6502 · · Score: 2

      I LOLed. :-)

      Except the throwing the device across the room usually isn't "accidental". ;-) The Wii control frustrates me to no end, especially when trying to play a rapid-paced game like Metroid Prime 3 or Sonic. I wish I could go back to using the gamecube controller because it is more precise & registers my inputs 99.999% of the time. (The wii control is more like 90% of the time, which is lousy.)

      --
      My AC stalker: " I personally agree with your posts most of the time, but that won't keep me from modding you troll"
    2. Re:More sales by Anonymous Coward · · Score: 2, Funny

      You just know WP7 gesture control is going to involve throwing chairs across the room.

    3. Re:More sales by Anonymous Coward · · Score: 0

      This will never work; every plan ending in profit has to have a distinct entry "??" applied immediatly before the profit.

    4. Re:More sales by AmiMoJo · · Score: 1

      I recently saw some people trying Samsung TVs with gesture control. Flailing your arms about while seated in a deep couch is hard, you look like an idiot and the person next to you gets punched in the face every time you change channel.

      The phone version sounds ideal for use on public transport.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    5. Re:More sales by x1r8a3k · · Score: 1

      Or by sweating on the phone.

  2. Couple questions... by awshidahak · · Score: 2

    So... what do you do? Set your phone on the table while you danec in front of it to send a text message? It's cool on the kinect, but seems weird on android. Also, shouldn't they be putting more energy into changing the name of google play store back to android market?

    1. Re:Couple questions... by DrgnDancer · · Score: 4, Insightful

      I suspect more like: "wave hand in front of phone instead of swiping". You'll probably still have to type on the screen or get a hardware keyboard, but this could free up some of the constant tapping and swiping across your viewing surface that you need to do for even the grossest control movement on a phone or tablet. Between this and improved dictation you could remove most of the need to touch the screen, but you're not going to completely eliminate it without a either a physical keyboard of someone coming up with a completely new paradigm.

      --
      I don't need a million points of light, just two points of multi-mode fiber and a 10 Gig-E router.
    2. Re:Couple questions... by WrongSizeGlass · · Score: 1

      So... what do you do? Set your phone on the table while you danec in front of it to send a text message? It's cool on the kinect, but seems weird on android. Also, shouldn't they be putting more energy into changing the name of google play store back to android market?

      Now come on. Clearly we'll all have to learn Sign Language in order to communicate with our phones, which is going to be tough to do while holding the phone if the sign requires two hands (unless, of course, your name is Zaphod).

    3. Re:Couple questions... by cpu6502 · · Score: 2

      I agree. 10 hours a day of waving my hand in front of my workscreen or phone would exhaust me. I am fundamentally-lazy and prefer to make as little movement as possible (i.e. use a mouse). I became an engineer because I wanted to find easier, simpler ways of doing things (less work) and waving my arms around like Tom Cruise in minority report is not easier. It looks very tiring.

      I've also noticed in Star Trek TNG or DS9 whenever they want to do real work, they put down the PADD and transfer the screen to a desktop (or laptop) with keyboard. It would be ideal if we could reach a similar level in curent technology where work could be freely transferred between the Phone and PC.

      --
      My AC stalker: " I personally agree with your posts most of the time, but that won't keep me from modding you troll"
    4. Re:Couple questions... by omnichad · · Score: 3, Interesting

      Well, if you were deaf, this would be one easy way to have real-time communication with someone. Getting a table mount for it would be the least of your concerns.

    5. Re:Couple questions... by nschubach · · Score: 1

      You use/swipe/touch your phone for 10 hours straight? Your fingers must be raw. ;)

      --
      Every time I start to have faith in humanity, I ruin it by driving to work between 7 and 8 am.
    6. Re:Couple questions... by Anonymous Coward · · Score: 0

      Where I think it will be the most useful is in GoogleTV devices. Currently, apps on GoogleTV devices are limited to keyboard/mouse entry and mouse entry is discouraged. With a Kinect-like interface, apps could use gestures and an emulated mouse could play a much larger role in the user interface.

      If you think of Android as being just a mobile phone, something like this doesn't make a lot of sense. But when you consider the breadth of the Android environment, it makes a lot more sense in other contexts.

  3. How fun! by Anonymous Coward · · Score: 0

    Hold phone close to read.
    Move phone back and gesture at it.
    Hold phone close to read that the gesture didn't work.
    Move phone back and gesture at it ...repeat x times

    Throw phone, gesture is recognized.

    1. Re:How fun! by lxs · · Score: 1, Insightful

      These days they can do wonders for myopics like you. There are glasses, contact lenses or they can fry your eyes with lasers.

    2. Re:How fun! by Anonymous Coward · · Score: 0

      I wish I had mod points.

      And there was a "-1: retard"

  4. Need to reboot X? by L4t3r4lu5 · · Score: 1
    --
    Finally had enough. Come see us over at https://soylentnews.org/
  5. Fingerprints by Inda · · Score: 1

    This is something I can't get my head around.

    People, me included, spend hundreds of pounds on a phone and then worry about it getting damaged, forgetting the fact that it'll be replaced for free when they renew their contract two years down the line. People, not me, spend money on ugly cases that turn their phone into something that no longer looks like an expensive phone. Hundreds of pounds for engineered hard plastic, metal and gorilla glass, for what?

    Me? I keep my S2 in my jeans pocket, without coins and keys. I have no case for it and yet it looks as good as the day I bought it, four months ago.

    Fingerprints are wiped off over the course of the day through jiggling in my pocket and my phone still looks classy and thin with no case.

    I ponder.

    --
    This post contains benzene, nitrosamines, formaldehyde and hydrogen cyanide.
    1. Re:Fingerprints by hobarrera · · Score: 3, Informative

      It's not everywhere you phone is free. I purchased a Nokia N900 (it's from 2009), used, for half a months salary here. And I'm pretty much middle class as well. So I'd rather take care of it, since buying another in two years is out of the question.

    2. Re:Fingerprints by Anonymous Coward · · Score: 0

      Please don't mess with the comments of rich people.

    3. Re:Fingerprints by singhulariti · · Score: 1

      Agree. I've never bought a protective case for my phone. Kind of voids the whole point of buying a 'sexy' looking phone!

    4. Re:Fingerprints by geekoid · · Score: 1

      I got my Nexus - S from best buy.
      For the same price as a screen and case I got a replacement plan. SO if it becomes damaged, I can replace it. This means I don't worry as much and just keep it in my back pocket.

      As an added bonus: I paid 99 dollars for the phone, and if I take it back to best buy I get a 119 dollar gift card.

      I do occasional buy custom back pieces. My last one Had Dr venture on it.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    5. Re:Fingerprints by Wovel · · Score: 2

      That is excessive. I hope you are single and childless. Otherwise,you are irresponsible.

    6. Re:Fingerprints by hobarrera · · Score: 1

      I am single, childless, AND irresponsable! :)

  6. Processing by Anonymous Coward · · Score: 0

    seems like all this extra processing would really do in a mobile device.

  7. Great... by Oswald+McWeany · · Score: 1

    Great- so now I have to memorise the riverdance choreography to unlock my phone for use?

    I am predicting strange looks from my coworkers.

    --
    "That's the way to do it" - Punch
    1. Re:Great... by hairyfeet · · Score: 2

      At least it'll be easy to get to the customer service line of your carrier, you'll just give the phone the finger.

      --
      ACs don't waste your time replying, your posts are never seen by me.
  8. Omni-tools by Andrio · · Score: 0

    Excellent. Smart phones will be one step closer to becoming omni-tools from Mass Effect. Now we just need to figure out how to do holographic projections, to have 3D images and interfaces that we can synchronize to the motion-input of these kinect-like controls.

    --
    The Internet King? I wonder if he could provide faster nudity.
  9. Same stuff, different device by Lord+Grey · · Score: 3, Interesting

    From Claim 1 of the patent filing:

    A method of controlling a portable electronic device including an image capturing device, the method comprising: detecting, via the image capturing device, motions of an object over the image capturing device; determining a type of the detected motions using timing information related to the detected motions, the timing information comprising duration of at least one of the detected motions; and controlling the portable electronic device based on the determined motion type.

    Claim 2 then says:

    The method of claim 1, wherein the type of the detected motions comprises single tapping, double tapping, hovering, holding and swiping.

    Then there is a lot of refinement, talking about edge detection, direction of movement, the usual definition of a computing device with memory, and finally kicking off predetermined actions based on recognized motions.

    But look at Claim 2: "... comprises single tapping, double tapping, hovering, holding and swiping." To me, this patent seems to be a simple extrapolation of the gestures Apple made popular with their mobile UI, with the addition of "hovering" (assuming I understand the definition of that word, here). Same gestures, different input control.

    Is there a significant difference between, say, swiping across a phone's screen and making the same gesture a few inches away? (I'm thinking that if the device interpreted motions from a larger distance then the only thing that will reliably happen is a serious of hilarious DoS attacks via interpretive dance.)

    --
    // Beyond Here Lie Dragons
    1. Re:Same stuff, different device by bigredswitch · · Score: 2

      Also sounds like the stuff from eyeSight. I used this a few years ago (on Symbian): http://www.eyesight-tech.com/technology/

      --
      After about three months of relentless Willy action I reckon I'm now as good as when I was 10.
    2. Re:Same stuff, different device by DragonWriter · · Score: 2

      Is there a significant difference between, say, swiping across a phone's screen and making the same gesture a few inches away?

      Maybe, maybe not, but this probably isn't about even "a few inches away". Look at claim 3: "The method of claim 1, wherein detecting motions comprises: receiving images from the image capturing device, each of the received images is associated with a motion of the object; determining an illumination level for each of the received images; comparing each of the determined illumination level to a predetermined threshold; and determining, for each received image, if the associated motion is a touch motion where the object touches on the image capturing device or a release motion where the object releases or stays away from the image capturing device based on the comparison." (emphasis added)

      It looks like the main focus here is to develop a system where if you have a camera with the right orientation and field of view, you don't need a touchscreen, you can use a non-touch display and still interact with it in much the same way as a touchscreen. This has the potential for lowering the cost of portable devices while providing essentially the same user experience compared to touchscreen devices.

      In addition to the kinds of devices that commonly have touch screens now, this could be used anyplace you are likely to have a display and a camera together where the additional cost of making the display touch would usually be prohibitive to provide a touch-like interface in addition to whatever existing control interface exists -- netbooks and traditional laptops (even desktop displays) would be an obvious use, giving you swipe-and-tap capability which could be convenient for more "consumptive" activities, while still keeping a traditional interface for more "productive" activities.

    3. Re:Same stuff, different device by Anonymous Coward · · Score: 0

      Aren't most of apple's patents things that have been done before, but slapped with the suffix "on a mobile device"?

  10. Wait, this is serious? by Baloroth · · Score: 1

    I mean, I knew they were working on Gmail Motion, but I though they left that idea when it stopped being April 1st.

    --
    "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
    1. Re:Wait, this is serious? by omnichad · · Score: 1

      You beat me to it. Of course, someone's already implemented this using a Kinect

  11. April Fools? by LoverOfJoy · · Score: 1

    Wasn't this an April Fools prank of theirs a while back?

  12. I, Phone by Oswald+McWeany · · Score: 1

    I see it now.

    I, Phone.

    The first rule of Phone-botics. Never ask for any gestures from a human to unlock the phone that could hurt a human.

    --
    "That's the way to do it" - Punch
  13. patents s*ck again by l3v1 · · Score: 1

    So basically they patent a decent motion detection algorithm, and they can do so just because it's used for controlling a portable electronic device including an image capturing device. How innovative. Don't get me wrong, I'm not against Google on this, such a feature could be great. But now everyone who was thinking on doing anything on android that would use visual motion information (which, surprise, comes from images through the camera) can go find something else to do. Well, businness as usual.

    --
    I am putting myself to the fullest possible use, which is all I can think that any conscious entity can ever hope to do.
    1. Re:patents s*ck again by Anonymous Coward · · Score: 0

      I'm on the verge of doing a search of the patent database for everything that includes the phrase "on a tablet" and submitting patent applications for each with the new scope of "using nanobots." I figure I'll either get rich, be marked as a villain in tech circles, or get some attention from the big players leading to a legal precident that voids their stupid patents.

      Maybe if I could get one with the phrase "while falling past a star at over 25km/sec" I could usurp the existing patents directly!

  14. Simple gestures by Anonymous Coward · · Score: 0

    A sartorial, restrained lateral hand motion, accompanied with "These are not the Droids you're looking for."

  15. Sign Language by Anonymous Coward · · Score: 0

    It would be awesome if they implemented "International Sign" as the method used to communicate with the device. Imaging everyone in the world would have a common communication language which even deaf people could use. When you didn't have your device you would still be able to communicate.

    https://en.wikipedia.org/wiki/International_Sign
    https://en.wikipedia.org/wiki/Sign_language

  16. Motion detection UI already exists for Nokia N9 by Wizzu · · Score: 1

    This is not the first such UI, there's already an existing gesture UI for Nokia's N9 phone. Relatively simple and experimental, but still.
    http://store.ovi.com/content/214364
    I have not tried it myself.

    Full disclosure: I work for Nokia, even though I've not had anything to do with this particular software.

  17. Does google do anything original? by Anonymous Coward · · Score: 0

    Yet another mediocre google me too product. Gee I hope it is as awesome as Google+

  18. False positives by gmuslera · · Score: 1

    As with voice, giving casual input to the detector that could be interpreted and acted on, even if not meant for the phone, is a potential danger.

  19. I hope this is just a funny joke by SalsaDoom · · Score: 2, Insightful

    Because otherwise, Smartphones and Tablets really are getting out of control.

    I thought -- and still do -- think its stupid to have a speech interface for a phone. I mean you look stupid talking to a robot woman on your phone. The last thing I want to do is start dancing in front of my phone.

    "Give me a sec, I have to do the shuffle to unlock my phone, and then the achy-breaky to open my email."

    I'm actually pretty happy with smart phone interfaces these days, just the way things are..

    --
    "Computers will never truly be free until the last windows user is strangled with the entrails of the last mac user."
    1. Re:I hope this is just a funny joke by x1r8a3k · · Score: 1

      Voice interfaces have their place. For example, I can use speech recognition on my phone to say "Navigate to 123 Main St City State" much faster than I can go to the nav app, tap the search button, and type it in.

      However, you don't have to use it. You can still do it all through taps and typing. I'm sure this motion interface will be completely optional too, so just ignore it.

    2. Re:I hope this is just a funny joke by Anonymous Coward · · Score: 0

      It works for you. You probably have an American accent. For the rest of us, it's just as fast to say it, but there's no guarantee the nav app will recognise anything on the first few tries or even that it won't take you somewhere else entirely.

  20. Your holding it wrong! by Nyder · · Score: 2

    Poor cellphones.

    At first, they were held like normal phones, up to your ears.

    Then came text messaging, and everyone was typing on a keypad.

    Then came little keyboards, so were weren't using the number pads.

    Then we got rid of the keyboards and used the screen for typing.

    Now they want us to hold the phone in front of us with 1 hand,while waving our hand (like a magician or something) in front of the phone.

    Wtf happened to using a phone like a fucking phone?

    Though I have to give props to google here, chasing a patent before everyone else, since this is the next step.

    but what happened to voice control? It's a phone, we talk into it, why not actually control it with our voice? Shit, i better get that idea patented...

    --
    Be seeing you...
  21. Prior art by Anonymous Coward · · Score: 0

    I think I've already seen things like this demonstated on informercial channels. Like having a laptop where you play tennis with your hands using the webcam. Am I missing something here?