Slashdot Mirror


Kinect Can Detect Clenched Fist

mikejuk writes "Microsoft Research is currently having a Techfest at Redmond where it is showing off a lot of new work. The latest work on the Kinect uses the same sort of machine-learning approach to distinguish between an open hand and a clenched fist. Although there are no details, its general method was to use a large number of images of people's hands and supervised training to distinguish between open and closed hands. The learning algorithm is based on a forest of decision trees, which is the same general method used to implement the skeleton tracking. Being able to detect an open or closed hand might not seem to be much of an advance, and certainly not as good as a multi-gesture touch screen interface, but it is enough to allow the user interface to distinguish a "pick up" or "grip" gesture. So you can move the hands within an image, close both hands to grip the image points and move apart to zoom. You can't get the software at the moment, but it has been promised for the next version of the Kinect SDK for Windows along with the long awaited 3D scanner Kinect Fusion."

65 comments

  1. GTA by meta-monkey · · Score: 4, Funny

    I hope the next Grand Theft Auto game is Kinect-enabled for pimpslapping.

    --
    We don't have a state-run media we have a media-run state.
    1. Re:GTA by DFurno2003 · · Score: 1

      Since when is Slashdot PC? Can't even say Bitchslapping anymore?

    2. Re:GTA by camperdave · · Score: 1

      Since when is Slashdot PC? Can't even say Bitchslapping anymore?

      Slashdot has always been PC... in the sense that it is anti-Apple.

      --
      When our name is on the back of your car, we're behind you all the way!
    3. Re:GTA by Anonymous Coward · · Score: 1

      It's a bitchslap if you use your palm, it's a pimpslap if you use the back of your hand.

    4. Re:GTA by Anonymous Coward · · Score: 0

      Lol anti-apple. I think the only site more pro-apple is probably maclife.com.

    5. Re:GTA by Anonymous Coward · · Score: 0

      Translation: I sometimes see pro-Apple (or rather, not-anti-Apple) posts that aren't modded down to -5 on principle, and that makes me angry because I am an insecure little twat.

  2. Potential applications by The+Mysterious+Dr.+X · · Score: 1

    I get that this could be great for mimicking the mouse click/drag, or for interactive boxing games. But what about its law enforcement potential? How long until this is used to detect possible domestic violence?

    1. Re:Potential applications by h4rr4r · · Score: 1

      You think most domestic violence is done by people who can afford a brand new console and peripherals?

      If it ever was possible, people would just leave the room to do that sort of thing.

    2. Re:Potential applications by Anonymous Coward · · Score: 0

      Obamer would love to be able to have that level of spying capabity.

    3. Re:Potential applications by RabidReindeer · · Score: 1

      You think most domestic violence is done by people who can afford a brand new console and peripherals?

      If it ever was possible, people would just leave the room to do that sort of thing.

      Well, there have been several recent incidents involving violence by people who weren't allowed to play video games when they wanted to.

      Reminds me a little bit of Fredrick Brown's story "The Little Black Bag"...

    4. Re:Potential applications by hedwards · · Score: 2

      Yeah, because it's only moneyless hillbillies that engage in spouse beating.

    5. Re:Potential applications by Anonymous Coward · · Score: 1

      Years ago, I had a black dude come in with his kids and ask me about xbox at my college job, he was asking release dates or something, and I told him you could find that on the internet... guess what he didn't have. My point is never underestimate people's distortions of priorities.

    6. Re:Potential applications by Anonymous Coward · · Score: 0

      Rihanna called, she wants her kinect back from evidence.

    7. Re:Potential applications by Anonymous Coward · · Score: 0

      wooosh.

    8. Re:Potential applications by Anonymous Coward · · Score: 0

      Don't kid yourself anon, so would any Rethuglican that got his job. Baby Bush is the one who started the whole spying on civilians thing. The only real difference between the parties is that one is focused on religion, and the other thinks maybe women and non-white people are entitled to the same dwindling rights that the rest of us have. They both love blowing people up and spying on them.

    9. Re:Potential applications by Anonymous Coward · · Score: 0

      Not long?

      http://www.cs.cmu.edu/~mychen/publication/ChenEMBC08.pdf

    10. Re:Potential applications by burning-toast · · Score: 1

      Years ago, I had a black dude come in with his kids and ask me about xbox at my college job, he was asking release dates or something, and I told him you could find that on the internet... guess what he didn't have. My point is never underestimate people's distortions of priorities.

      Don't know if you realize that your statement comes off as having a secondary implication, but that same story works great without the skin color being mentioned:

      Years ago, I had a dude come in with his kids and ask me about xbox at my college job, he was asking release dates or something, and I told him you could find that on the internet... guess what he didn't have. My point is never underestimate people's distortions of priorities.

      If it was intentionally stated, you are a dick. If not I hope I helped.

      - Toast

  3. Can it detect a middle finger? by Kenja · · Score: 4, Funny

    Cause that would speed up a lot of forum conversations.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
    1. Re:Can it detect a middle finger? by QilessQi · · Score: 2, Informative

      There would be plenty of training data. Users of Microsoft systems employ that gesture frequently.

    2. Re:Can it detect a middle finger? by Anonymous Coward · · Score: 1

      It doesn't detect it because it assumes it is a penis. Don't wave it around, because then the software will interpret it as a penis helicopter, which will get you a perma-ban on Xbox Live.

    3. Re:Can it detect a middle finger? by drinkypoo · · Score: 1

      There would be plenty of training data. Users of Microsoft systems employ that gesture frequently.

      I don't have a Kinect, so if I want my 360 to know when I'm pissed off that it did something stupid I have to plug in a microphone so it can hear me say "Fuck you".

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    4. Re:Can it detect a middle finger? by Anonymous Coward · · Score: 0

      There would be plenty of training data. Users of Microsoft systems employ that gesture frequently.

      I don't have a Kinect, so if I want my 360 to know when I'm pissed off that it did something stupid I have to plug in a microphone so it can hear me say "Fuck you".

      Your Xbox isn't sentient, you know. But even if it were, why don't you just throw the controller against the wall. That has always worked for me (and I recommend you keep superglue and plaster handy). There is no better feeling during a rage-quit than the sound of breaking plastic.

    5. Re:Can it detect a middle finger? by drinkypoo · · Score: 2

      Your Xbox isn't sentient, you know. But even if it were, why don't you just throw the controller against the wall.

      Because Xbox controllers are expensive and fragile. With the NES I could vent my anger by swinging the controller by the cord and bouncing it off the (lino-covered plywood) floor as hard as I could, and then I could go back to playing...

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  4. But cant it detect... by future+assassin · · Score: 1

    a clenched ***** OMG!

    Sega already beat them to the clentched sphincter http://www.retrojunk.com/commercial/show/10889/sega-saturn-commercial-the-theatre-of-the-eye

    --
    by TheSpoom (715771) Uncaring Linux user here. I have nothing to add to this but please continue. *munches popcorn*
  5. fingers by hresult · · Score: 1

    Can it detect middle finger though? I show it to Kinect all the time, and it seems to be ignoring it.

  6. We're getting closer... by Antipater · · Score: 5, Funny

    The dream of being able to punch someone through the internet took a step forward today.

    --
    Everything is better with chainsaws.
    1. Re:We're getting closer... by alexgieg · · Score: 1

      The dream of being able to punch someone through the internet took a step forward today.

      This is nothing. Now every sith lord out there will be able to force chocke through the Internet. Much more satisfying.

      --
      Conservatism: (n.) love of the existing evils. Liberalism: (n.) desire to substitute new evils for the existing ones.
    2. Re:We're getting closer... by Anonymous Coward · · Score: 0

      KHHHHAAAAAAAAN!!!

    3. Re:We're getting closer... by DFurno2003 · · Score: 2

      The dream of getting a HJ through the internet took a step forward today.

    4. Re:We're getting closer... by Zalbik · · Score: 1

      Posting to undo moderation....

      I wish I could punch the slashdot moderation developers through the internet....

      Somebody +1 funny the parent please!

  7. And yet by Anonymous Coward · · Score: 0

    The best they can do is Dancing Slave Leia or Dancing Han Solo? Talk about a technology searching for a purpose.

  8. A huge step forward for Kinect by Graydyn+Young · · Score: 2

    The biggest problem with Kinect controls is the lack of gesturing. This results in users needing to hold their cursor over a control for a couple seconds in order to simulate a click or button press. For obvious reasons, this makes the whole control scheme brutally slow. Even worse was the solution used in Child of Eden, where the user need to push their hand forward, thus making the Kinect controls much more difficult than using a normal controller. Just this one gesture to function like a mouse click will greatly improve the user experience for all OS/menu controls and many games.

  9. Microsoft demoed at E3 this two years ago by YesIAmAScript · · Score: 2

    The did it at E3 2011 where Kinect Fun Labs was showed.

    The guy demoing it waved his fists around and it tracked them. When he put fingers out on one hand he was able to draw lines on the screen, it saw the finger out.

    In that case and this one too it was clear that this was so close to the limits of what Kinect can resolve that it wasn't going to be reliable in normal use. But it did work on stage.

    http://www.youtube.com/watch?v=5jso9r6DI9E&t=3m20s

    MS claimed they would ship this, even named it "Kinect Finger Tracking". But it didn't ship yet. It's likely the current hardware just isn't reliable enough at it.

    --
    http://lkml.org/lkml/2005/8/20/95
    1. Re:Microsoft demoed at E3 this two years ago by Samantha+Wright · · Score: 2

      The commercial Kinect cameras are 640x480. Even if that's decent for finger-level tracking close up, a method designed to measure the activities and placements of fingers close to the camera is not going to have enough data to work on hands further away.

      That being said, it does appear that the demo in the video you linked has sufficient discriminatory power that a fist should be relatively easy—he's not exactly holding his hand right up to the lens.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    2. Re:Microsoft demoed at E3 this two years ago by Samantha+Wright · · Score: 2

      ...and continuing on that point, now that I think about it, all that video shows is tracking the tip of a moving object. That's not really the full hand.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
  10. Cool but by TheSkepticalOptimist · · Score: 1

    Do you still have to make a gun out of your hand and go "pew, pew" when you play FPS?

    --
    I haven't thought of anything clever to put here, but then again most of you haven't either.
  11. They are making money hand over fist! by MmmmYah · · Score: 1
    I heard the virtual porn industry suddenly took notice.. Kinect the dots..

    - Jack Off All Trades

  12. About to get removed in 3...2...1 by Anonymous Coward · · Score: 0

    Just like ALL the other "advances" they added to it.

    Pretty sure Kinect was able to do this crap years ago before it came out in the gimped awful form we know now.

    Here is hoping they do, the first game I will put up on Kinect is Punch Steve Ballmer in the back of the head.
    Wait, the thing he speaks from is the back of his, right?

  13. Chairs or GTFO! by CajunArson · · Score: 1

    Unless it can detect chairs (mid-flight of course), then I don't see it being much use for Microsoft!

    --
    AntiFA: An abbreviation for Anti First Amendment.
  14. "Kinect Can Detect Clenched Fist" by John+Hasler · · Score: 3, Insightful

    So it knows when you are about to smash it?

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  15. Drone manufacturers should love it? by Anonymous Coward · · Score: 1

    Such things have been speculated about as early as 2008 from what I can tell (http://www.wired.com/dangerroom/2008/07/wargames/)... I don't think it's actually the case quite frankly, it seems too far-fetched, but the kinds of science fiction that could be written about the idea -- an entertainment company batting advertisments about for their new video game technology, that can detect a closed fist, a concealed weapon, a facial expression that suggests aggression or a lie.

    That same article linked to a picture from a British army TV advertisment in which a UAV was being piloted by a soldier...using an XBOX 360 controller. Now again, is MS hardware actually being used that way? Probably not -- but you know just by virtue of how sue-happy the U.S. is that Microsoft knew the controller would be on-screen, that its suggested use would be for piloting a drone...and they thought that, at the very least, it would be a good marketing opportunity? That's the kind of thing that makes most people say, "I wouldn't put anything past them."

  16. Waste of resources by Anonymous Coward · · Score: 0

    Why does Microsoft need a team of researchers to distinguish this? An open hand is what I slap them with, and a clenched fist is what I punch them with.

  17. Re$pect for M$ by Anonymous Coward · · Score: 0

    Kinect is the only thing Microsoft did that impressed me. That and the Metro UI, even if it fell flat, at least is was not a copy from Apple.

  18. Can it read by NEDHead · · Score: 4, Insightful

    ASL? That might be useful

    1. Re:Can it read by Anonymous Coward · · Score: 0

      KinectBot: Nice to meet you, NEDHead!
      KinectBot: I'm 18/F/$(lookup-city NEDHead)!
      KinectBot: How about you?

  19. Careful. by DougOtto · · Score: 0

    Your XBox can see you masturbating.

    --
    Solving Unix problems since 1989...
  20. A truly immersive interface by Immerman · · Score: 1

    What I don't get it why isn't there more noise about a wii remote-esque controller for the Xbox? Seems like that would complement the Kinect wonderfully, the one catches posture and absolute position, while the other catches the subtleties of acceleration and orientation of your hands and provides buttons for precision input. Throw in a VR helmet when the Occulus Rift hits the stores ad you'd have all the pieces to take the first steps into consumer-grade VR.

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
    1. Re:A truly immersive interface by triffid_98 · · Score: 1

      "I love the Power Glove. It's so bad"

  21. I wonder what other finger gestures it can detect by Anonymous Coward · · Score: 0

    I've got one that I tend to use a lot for microsoft products.

  22. Kinect Fusion is already availabe by Anonymous Coward · · Score: 1

    " long awaited 3D scanner Kinect Fusion"

    There are already several open Source implementations in the PCL (pointclouds.org/) so there is no need to wait for Microsoft
    to publish an SDK...

  23. Big whoop: Leap Motion can detect a pencil point by DaTrueDave · · Score: 1

    https://www.leapmotion.com/

    And they just announced that they're shipping in May!

    If you haven't heard of Leap Motion, check out this video: https://www.youtube.com/watch?feature=player_embedded&v=_d6KuiuteIA

    Once you have that type of precision, I would imagine "learning" what a fist is wouldn't be quite as difficult...

  24. Finally by operagost · · Score: 1

    We can finally actually punch someone in the face over the internet!

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  25. Clenched Fist Activity by ThatsNotPudding · · Score: 1

    Next up; determining if that clenched fist is wrapped around something and is moving back and forth along the same mainly vertical path.

  26. that's ridiculous by slashmydots · · Score: 0

    The Kinect can't even tell the difference between me, my roommate, and our couch and it's lucky if it can find my hands. I'm sure under absolutely perfect conditions with proper surroundings inside a subterranean bunker, it could detect a clenched first 10% of the time. In reality, you'd need a 200x more accurate Leap Motion system to do that. Btw, google that. Their website has an epic video.

  27. WTF? by Anonymous Coward · · Score: 0

    I was part of a coding session, and in 12 hours we came close to doing this with the kinect on Ubuntu without machine learning. We eventually settled for finger stretched out since it worked better and we were on a time limit. Given a week and machine learning, we could have done this in a week.

  28. Re:Big whoop: Leap Motion can detect a pencil poin by Anonymous Coward · · Score: 0

    But they don't provide users with the point cloud yet, so it is currently impossible to detect a fist with leap so far.
    The sensing range of the leap is also much smaller. The Kinect has a range of several meters, the Leap of around 80cm.
    So it's not fair to compare their accuracy without mentioning the restrictions.

  29. Turn off kinect before watching porn on your Xbox. by Anonymous Coward · · Score: 0

    Or maybe masturbation will now have achievements and a leader board on Live.

  30. can they bring that to Windows 8? by swschrad · · Score: 1

    when, if the webcam sees a clenched fist and angry, set face, it reverts to Windows XP???

    --
    if this is supposed to be a new economy, how come they still want my old fashioned money?
  31. Why Kinect? by qbitslayer · · Score: 1

    What is so special about recognizing a fist that requires Kinect? A cheap camera with some visual recognition software can do the same and probably better and quicker. Just saying.

  32. Awesome! by elabs · · Score: 1

    It's not easy to detect fingers at a distance with that type of resolution. I hear the Kinect 2 will have a higher resolution (made possibly by the greater bandwidth of USB 3.0) and lower latency. Kinect continues to rock!

  33. Going to hell for this by Just+Some+Guy · · Score: 1

    I'm imagining the DLC for "Rock Band featuring Rihanna".

    --
    Dewey, what part of this looks like authorities should be involved?
  34. Fist of Comedy by Anonymous Coward · · Score: 0

    Yeah, but can it detect the Fist of Comedy?

    Shout out to the Terry, Bill & Steve show.

  35. Hummmm by Anonymous Coward · · Score: 0

    And just what might be clinched in the fist as it moves up-down-up-down very rapidly ?

    XD

    Release the Kraken !

  36. Discount D&G shoes,LV shoes,Women Boots sale by xiuchuni · · Score: 1

    The website wholesale and retail for many kinds of fashion shoes, like the nike,jordan, also including the jeans,shirts,bags,hat,glasses and the decorations. All the products are free shipping, and the price is competitive, after the payment, can ship within short time. the goods are shipping by air express, such as EMS,DHL,the shipping time is in 5-7 business days ! YOU MUST NOT MISS IT http://www.sport3trade.net/ Discount jordan shoes $35, Air max shoes $35, Nike/shox $35, handbags $36, Sunglasses $16, New era cap $12, wallet $19, belt $18, jewelry $15, T-shirts $20, DG Jeans $36, (NFL MLB NBA NHL) jerseys $25, http://www.sport3trade.net/