Slashdot Mirror


Microsoft Kinect With World of Warcraft

An anonymous reader writes "Researchers at the University of Southern California Institute for Creative Technologies have developed software that enables control of PC video games using the Microsoft Kinect sensor. Their toolkit, known as the Flexible Action and Articulated Skeleton Toolkit (FAAST), emulates custom-configured keyboard controls triggered by body posture and specific gestures. This video shows a user playing the online game World of Warcraft using the Kinect. Potential applications of this technology include video games for motor rehabilitation after stroke and reducing childhood obesity through healthy gaming."

80 comments

  1. Horrible by QuantumG · · Score: 3, Interesting

    Anyway, has anyone actually done streaming skeletal recognition over the web yet? Seems that's the kinda thing that would be an interesting addition to Second Life or some of the other "open" virtual worlds.

    --
    How we know is more important than what we know.
    1. Re:Horrible by Anonymous Coward · · Score: 0

      Yeah, Second Life would be perfect place. Nobody would make any inappropriate movements to the women there. On the other hand, maybe it doesn't matter since the women are really men anyway.

    2. Re:Horrible by DamienRBlack · · Score: 1

      Yeah, Second Life would be perfect place. Nobody would make any inappropriate movements to the women there. On the other hand, maybe it doesn't matter since the women are really men anyway.

      Yeah, and who cares if we let men sexually harass other men?

    3. Re:Horrible by devxo · · Score: 1

      My wife would become jealou.. oh who am I kidding, she would just laugh and call me gay.

    4. Re:Horrible by Opportunist · · Score: 1

      Oh right, if Second Life needs one thing it is more realistic pelvis thrusts.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  2. I like PvP by BRSloth · · Score: 0

    And, in the final part, I was here, just waiting for a Tauren Paladin to jump into scene and gank the mage while the guy was explaining why it would be a good thing for kids.

    Yes, I'm that horrible.

    1. Re:I like PvP by Endo13 · · Score: 1

      Yes, I'm that horrible.

      Also apparently not very observant. He wasn't flagged for PvP.

      --
      There is no -1 Disagree mod. Slashdot.org/faq defines mod options. USE IT.
    2. Re:I like PvP by uolamer · · Score: 1

      I could see him trying to use those gestures to try to defend himself. I just do not think it is reasonable to think anyone can play nearly as good with any of these current motion capture devices compared to having a keyboard.. DPS will drop, it will fail to pick up a gesture here and there, etc. I am sure this is quite fun and has it uses though.

      --
      s/©//g
    3. Re:I like PvP by Krneki · · Score: 1

      Yes, I'm that horrible.

      Also apparently not very observant. He wasn't flagged for PvP.

      He was an engineer camouflaged as a sheep.

      --
      Love many, trust a few, do harm to none.
  3. Raid by mseeger · · Score: 4, Funny

    I would love to see a Raid of 25 people using this. It should look like some kind of ballet.

    CU, Martin

    1. Re:Raid by durrr · · Score: 1

      It wouldn't look like anything at all because due to blizzards fascist grade tos they would have everyone banned for botting/macros.
      They would then release a Blizzard-certified movement-controlled-wow-interface for $300.

    2. Re:Raid by mseeger · · Score: 3, Interesting

      I played WoW for several years with G5 keyboard (which is very macro-friendly) and never had any problems with Blizzard..... AFAIK no one was ever banned for using a specific input device unless he/she actually used it for botting.

    3. Re:Raid by Opportunist · · Score: 1

      I'd guess it would look more like a very weird variant of caramelldansen.

      Just when you thought the DDR fad was over...

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    4. Re:Raid by Krneki · · Score: 1

      In my last half of year of WoW, since I got too bored I was just botting.

      I didn't run in a problem once. All you have to do is to rename the exe file and don't be AFK.

      The truth is, unless you are AFK and playing 24/7, they can't find you.

      --
      Love many, trust a few, do harm to none.
    5. Re:Raid by Anonymous Coward · · Score: 0

      It should look like some kind of ballet

      More like some sort of St Vitus' dance.

    6. Re:Raid by Ephemeriis · · Score: 1

      It wouldn't look like anything at all because due to blizzards fascist grade tos they would have everyone banned for botting/macros.

      They would then release a Blizzard-certified movement-controlled-wow-interface for $300.

      There's a huge difference between botting and using a fancy input device.

      Lots of people use macro-friendly input devices like the fancy Logitech keyboards. I personally used a Nostromo n52 for years.

      --
      "Work is the curse of the drinking classes." -Oscar Wilde
    7. Re:Raid by Nos. · · Score: 1

      "Who the hell aggro'd that patrol?"

      "Sorry, I was just trying to scratch my ass"

    8. Re:Raid by mseeger · · Score: 1
    9. Re:Raid by Anonymous Coward · · Score: 0

      Botting in WoW? That's more pointless than anything I've heard before. I spent my last half a year in that game ruining the server's economy in a True Capitalistic manner.

    10. Re:Raid by JBBW · · Score: 1

      This is true. You can be banned for 'unattended playing' but not much else. It looks like this is just about the opposite of that.

    11. Re:Raid by Anonymous Coward · · Score: 0

      It would probably look more like 25 people failing miserably. I'd love to see a healer be able to pick out one person out of 25 quickly and accurately to heal them using hand gestures.

    12. Re:Raid by Anonymous Coward · · Score: 0

      I literaly LOL'd on that one. Nice!

    13. Re:Raid by Nyder · · Score: 1

      Botting in WoW? That's more pointless than anything I've heard before. I spent my last half a year in that game ruining the server's economy in a True Capitalistic manner.

      you were playing a Wall Street Executive? Wow has that class?

      --
      Be seeing you...
    14. Re:Raid by Krneki · · Score: 1

      Botting in WoW? That's more pointless than anything I've heard before. I spent my last half a year in that game ruining the server's economy in a True Capitalistic manner.

      you were playing a Wall Street Executive? Wow has that class?

      I was doing that too. Botting and creating an artificial deficit of selected goods by buying everything out of the AH under certain price. Of course I had no use of all this money and when I quit, I gave everything to my guild mates.

      --
      Love many, trust a few, do harm to none.
  4. College Essay by Esspweb · · Score: 1

    Awesome post. Thanks for sharing a useful information.

  5. Actors make science! by Anonymous Coward · · Score: 0

    tx for informations, steven seagal

  6. How long before... by Hognoxious · · Score: 1

    1) Dislocate/sprain something while using this device
    2) Hire lawyer
    3) ...
    4) PROFIT!!!!!

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  7. Re:What next? by Anonymous Coward · · Score: 0
  8. reducing childhood obesity through healthy gaming? by GuyFawkes · · Score: 2

    why not simply go outside and play a REAL LIFE fucking game instead of some shite computer game if your concerns include childhood obesity....

    in addition to burning more calories, using more muscle groups, and breathing fresh air, you will also learn to speak to and relate to other human beings, first hand, and learn essential social skills like co-operation and mutual goal seeking...

    ffs

    --
    http://slashdot.org/~GuyFawkes/journal
  9. Re:What next? by Anonymous Coward · · Score: 0

    Ah, Youtube, censoring one video at a time. Things like this makes me hate children. Because of those little fucks the internet - media in general really - gets censored left and right. Stupid little cunts!

  10. Re:reducing childhood obesity through healthy gami by nschubach · · Score: 2

    As a side note... I found when I was heavily into MMOs, I actually lost weight. Crazy, I know... but I wasn't sitting on the couch with a bag of chips in one hand because that would get my keyboard and mouse all nasty. I actually ate better (less junk food) when I was playing because carrots weren't as greasy, I had bought more food from the grocery store so I had more time to play (didn't have to get in the car and run to Wendy's) and could grab a sandwich when I was hungry.

    --
    Every time I start to have faith in humanity, I ruin it by driving to work between 7 and 8 am.
  11. Too much movement by Bensam123 · · Score: 1

    Maybe I'm being lazy, but call me when finger flicks and other small gestures can be used and detected properly. Keyboards and mice work so well because you don't need to exert tons of effort into doing a simple task. Our hands are one of our best features for mimicking any sort of device till you can wire it into your brain. Doing a 25ms reaction with your fingers is a lot easier then with your back. Kinect just seems more like a gimmick and a Wiii too (me too) thing, then something extremely usable.

    I could, however, see the Kinect making it's way into the industry sector, specifically for mimicking motorized arms or construction equipment... and also porn industry.

    1. Re:Too much movement by GrumblyStuff · · Score: 1

      Too much standing.

      I could only watch the first ten seconds because it just looked so uncomfortable. There was nothing natural or intuitive about the movements and WoW? Seriously, they used WoW as they're example? They need a much simpler game (and a reason to be standing) to make this shine.

    2. Re:Too much movement by babywhiz · · Score: 1

      Agreed. Not to mention, just one mob in Dustwallow? Lame. Let's see him run that sucker in Twilight Highlands doin' the dailies out there. Or on FTA/FTH run...or in AV..... I agree, finger flicks and/or face gestures (sticking my tongue out to pop hero/bloodlust...oh yea...). Call me when I can fake a yawn to thunderfk people off a bridge.

    3. Re:Too much movement by AmberBlackCat · · Score: 1

      Between the number of people I've heard complaining about the Kinect requiring too much movement, and the number of people jumping on the "motion gaming" bandwagon, it almost seems like Nintendo got it right. The sweet spot between making games more physical and not making them too physical. Even senior citizens can play Wii games. I guess you can't just jump into full motion. Maybe go from using just your hands to involving your arms too. And maybe one day we'll be ready for games that involve the whole body.

    4. Re:Too much movement by ShakaUVM · · Score: 1

      Agreed. Not to mention, just one mob in Dustwallow? Lame. Let's see him run that sucker in Twilight Highlands doin' the dailies out there. Or on FTA/FTH run...or in AV..... I agree, finger flicks and/or face gestures (sticking my tongue out to pop hero/bloodlust...oh yea...). Call me when I can fake a yawn to thunderfk people off a bridge.

      Ah, that's right. I knew there was a reason I didn't go back into WoW for Cata.

      The players.

    5. Re:Too much movement by Anonymous Coward · · Score: 0

      hahaha wish I could +1. The players are the only thing keeping me from checking out cataclysm.

    6. Re:Too much movement by Scarumanga · · Score: 1

      Well if you are near-fit you should have no issues with it. I can see some folks scoffing at physical movement to play games, because it is too hard for them...it would be a wake up call saying "hey get the F in shape so you can play these new sweet interactive games".

  12. Re:What next? by cheekyjohnson · · Score: 1

    Why is it that you don't wish to protect the children? I bet you're a child molester! If you truly cared about them, then you'd know that children can't differentiate between fiction and reality (such as video games, movies, or pornography) and that they are just a picture/video/game away from becoming murderers and/or rapists! Seeing a nude person could cause them to be scarred for life. That's precisely why everything must be censored or be made extremely difficult to obtain.

    --
    Filthy, filthy copyrapists!
  13. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    Wow...just wow... This has got to be one of the most pothetic things I've ever heard

  14. Re:reducing childhood obesity through healthy gami by giorgist · · Score: 1

    Calm down ... these kids are not going outside. Maybe we can get them active.

  15. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    I went the other direction, I started eating Cheetos with a spoon. Get a bowl of sour cream and a bag of cheetos, sprinkle on the cheetos and nom nom.

  16. Re:reducing childhood obesity through healthy gami by Antisyzygy · · Score: 1

    There are a subset of people that have no interest in other human beings. I for one am too cranky.

    --
    That brings me to an interesting point, / . is just "the ramblings of socially-inept, technology-literate news-mongers".
  17. Re:reducing childhood obesity through healthy gami by liamoshan · · Score: 2

    why not simply go outside and play a REAL LIFE fucking game instead of some shite computer game if your concerns include childhood obesity....

    in addition to burning more calories, using more muscle groups, and breathing fresh air, you will also learn to speak to and relate to other human beings, first hand, and learn essential social skills like co-operation and mutual goal seeking...

    ffs

    Posts like this make me wish there was a "+1: Troll" option

  18. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    why not simply go outside and play a REAL LIFE fucking game instead of some shite computer game

    ffs

    I don't know...but maybe it's because smacking other people with huge swords and axes is ILLEGAL?

  19. n00b mage by PhrstBrn · · Score: 1

    Look at his keybinds, I bet he's a dancer.

  20. Re:reducing childhood obesity through healthy gami by nullifi · · Score: 1

    I agree. I got back into WoW with Cataclysm. I quit for a few months every now-and-then because of classes. When I can't find time for homework plus wow after my job, I don't login for a month or so. Anyways, yeah, I eat a lot better food whenever I'm gaming constantly Apples for a snack instead of some chips and dip. I also find I'm not hungry as often. I'll look at the clock and notice three hours have gone by, and I "should probably" eat dinner, right after I finish this quest hub. Then it's midnight and I need to go to bed.

  21. That's nothing! by Veggiesama · · Score: 1

    Real men (and frost mages) play with a wheel and pedals.

    Okay, Slashdot, let's do what you do best and turn WoW-play with unconventional devices from a mere YouTube fad to a full-on institution of social progress. That's right: WoW-play powered by a treadmill, Mountain Dew cans, and buckets of oily skin run-off.

    Let's start a revolution.

    Let's change the world.

    Let's... hey, why's that guy playing WoW when he could be having sex on his Kinect? Urgh... Goddamnit, Microsoft.

    1. Re:That's nothing! by stewbacca · · Score: 1

      From me, a grown-up who barely has time to play GT5 and WoW, I rate this +1 Awesome.

  22. Re:reducing childhood obesity through healthy gami by nullifi · · Score: 1

    And.. I did not mean to capitalize "apple". I hate "Apple" and don't own any of their products.. this scares me.. what does it mean?

  23. Re:reducing childhood obesity through healthy gami by BobMcD · · Score: 1

    Well, aside from 'getting off your lawn', can you cite any way that this would be worse than going outside? The criteria you've left here is pretty weak:

    A) burning more calories - This depends on the length and availability of play, doesn't it? Which of the two options would be susceptible to weather? Scheduling conflicts?

    B) using more muscle groups - Um, no. Not necessarily. The wireframe is full-skeletal. You could make walking tied to leg movements, for example. You could tie 'attack' to 'jumping' and really work the little suckers to death...

    C) breathing fresh air - Indoor air can easily be preferable, especially in an urban setting. And where it is not, windows can easily be opened.

    D) learn to speak to and relate to other human beings - Ventrillo. Been there, done that.

    E) learn essential social skills like co-operation and mutual goal seeking - Indoor games are usually better at this because they're more structured.

    Now for some points of my own:

    1) Aren't parents presently required to observe their children at all times when they're outside, due to 'stranger danger'? Would not indoor exercise solutions mean a net gain for those kids?

    2) Are indoor and outdoor exercise mutually exclusive? And if they're not, wouldn't replacing exercise-less video gaming with this concept be a net gain as well?

    3) Can you think of any ways in which this idea is actually worse than sedentary video gaming?

  24. WoW? Probably not - but what else? by BobMcD · · Score: 1

    I'm not liking the way WoW plays with this interface. I'd think, at a minimum that you'd want to use controller-plus-body. There's just too damn many buttons.

    Sports titles would be good. Are there any good ones for PC?

    Or perhaps Kinect-plus-WiiZapper for some awesome FPS action?

    WoW sucks as an example, but surely we can do better...

  25. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    uh well when i can shoot fireballs in real life i will. that (incredibly palyed out) joke only really works when the game simulates a real life activity, like a video game about running or swimming.

  26. Re:reducing childhood obesity through healthy gami by afidel · · Score: 2

    You'd be surprised how many calories a good session with the kinect can burn. My wife's cousins are 16 and 14 and are both cheerleaders (highschool and competitive squads) and even they were sore the next day from playing. Of course the wow controller seemed to only focus on hand gestures so it's a lot less cardio than the xbox titles that exercise the entire body.

    --
    There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
  27. Re:reducing childhood obesity through healthy gami by JonySuede · · Score: 1

    There is nothing to fear unless you start eating Apple product, since that is not that healthy ;)

    --
    Jehovah be praised, Oracle was not selected
  28. Re:reducing childhood obesity through healthy gami by babywhiz · · Score: 0

    I agree. At least with WoW, it's easy to forget to eat....and .... of course...when I do go to the fridge downstairs...I end up running there and running back....

  29. The game input policy by subanark · · Score: 1

    The policy of using custom input devices to play WoW is as follows:
    Every input into the game must be associated with a user interaction. The device delivering the input must deliver the input as quickly as possible when the user inputs the command, in that delaying input into the game is not allowed. Finally, the device must not analyze the state of the game other than if the game is receiving the input when making decisions on what input command corresponds with the user input (or if the command from the user should be ignored or not).

    What you can do is:
    Set up combos on your input device where a different input is given after inputting the same command, as long as the device doesn't investigate what WoW is doing.
    Control multiple computers with a single device, and send commands to multiple computers with a single user input.

    1. Re:The game input policy by NoSig · · Score: 1

      You can't make one mouse or keyboard click result in multiple clicks, so many programmable keyboards count as botting. That is because this defeats the very carefully orchestrated limitations in the Blizzard macro system. Specifically, it is set up so that a macro cannot continue past an error, such as trying to use an ability that is on cooldown (and that triggers the global cooldown (GCD) if available). You also cannot investigate from a macro if an ability is available, so the effect is that a single button press can only attempt to do a single GCD action and cannot recover if that single actions isn't possible at the time. Bypassing this limitation using a programmable keyboard allows you to do things like "use ability A if available, otherwise use ability B". Blizzard does not allow that.

    2. Re:The game input policy by starfire83 · · Score: 0

      Actually, you're wrong. The Blues (Blizzard forum CMs) have stated in many instances that so long as there is user interaction to perform an action using an input device, that input can go to one or more game clients. That's why they allow multi-boxing, among several other reasons. The key factor is the user interaction. Any automated actions lacking any kind of user input are deemed as botting. Programmable keyboards and mice only count as botting in the instance of "use A if available, otherwise use B" simply because there was only user interaction for one of the actions. As long as there is a button press for each action, it's okay even across multiple game clients on a single or several PCs. You can also check to see if an ability is available to use using the !Spell syntax (must be the exact name of the spell including spaces). For activated/proc'd abilities like Rune Strike or Hammer of Wrath, it will use those spells if they are available along with anything else in the macro, GCDs willing. You can also reset a macro in a certain amount of time measured in seconds (reset=x) followed by the contents of the macro. The Lua language that addons and macros use is fairly robust for in-game actions.

  30. Re:reducing childhood obesity through healthy gami by shutdown+-p+now · · Score: 1

    Um, are there hot dark elves in this new "Real Life" game you're pitching to me? ~

  31. Offset sedentary aspect of game? by anymouse · · Score: 1

    At least this would get me out of my chair and into motion more. A sign of playing too much is that not only do I know what kind of character he is playing and his approximate level, but also exactly where he is in the Warcraft world.

    --
    --The early bird may get the worm, but the second mouse gets the cheese
  32. Everuest 2 by Anonymous Coward · · Score: 0

    Hmm.. Kinda shows how Everquest 1 and 2 is for adults...

  33. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    > why not simply go outside and play a REAL LIFE fucking game instead of some shite computer game if your concerns include childhood obesity....

    Ah, sounds like a typical jock response. Of course, the typical jock response forgets that even in the best case scenario, no one wants the fat kid on their team (average case: fat kid gets picked on). Maybe you stayed in and played computer games, so you were never in either role and therefore don't remember this.

  34. Re:reducing childhood obesity through healthy gami by GTRacer · · Score: 1

    Why? What's pathetic about making rational choices? nschubach wants to play a game with his/her own time and chooses to optimise food runs in both a time and health-positive way and you complain? If I could do voices, I'd be saying, "Win freakin' win, baby!" in a solid Peter Griffin.

    I personally like sandwiches so a lot of my snacking (whether gaming or not) is from that food group. But it's nice to have something pretty tasty and filling that won't get everywhere when playing.

    Do you like sandwiches?

    --
    Defending IP by destroying access to it? That makes sense, RIAA/MPAA. Go to the corner until you can play nice!
  35. Prior art or patsy? by HalAtWork · · Score: 1

    So is a lot of "prior art" being created so that many of these methods become free to implement, or is it possible that patents on these techniques have already been snapped up and this is just free crowd sourced R&D and fleshing out of the logistics so that only Microsoft and PrimeSense can implement any of this commercially?

  36. pet control by hpavc · · Score: 1

    This guy needs to learn some pet control, what a waste.

    --
    members are seeing something, your seeing an ad
  37. Re:reducing childhood obesity through healthy gami by Ouka · · Score: 1

    Cheetos should only be eaten with chopsticks. Just sayin...

  38. Steven Segal by jago25_98 · · Score: 1

    Not at all surprised to see him moving into a sideline with WoW, not surprised at all.

  39. Re:reducing childhood obesity through healthy gami by dadelbunts · · Score: 1

    Why dont you go outside and talk to people instead of sitting inside posting on slashdot. Crazy i know but you could be actually interacting with people. VOCALLY without a microphone.

  40. Re:reducing childhood obesity through healthy gami by nschubach · · Score: 1

    I do go out... all the time. I go out and go to work (I even take the stairs up to the third floor office,) I go out and go to the bar some weekends, I regularly go out with REAL people to eat at times too. GASP!. I don't sit at my PC constantly and I don't know where you got that idea.

    --
    Every time I start to have faith in humanity, I ruin it by driving to work between 7 and 8 am.
  41. Re:reducing childhood obesity through healthy gami by dadelbunts · · Score: 1

    ah ah was trying to reply to parent must of clicked something wrong. sorry for the confusion was just trying to point out how ridiculous it is to complain about people not going out and playing a game whilsts they are themselves not going out and posting on a message board on slashdot

  42. U-Force v2 by InvisiBill · · Score: 1
    http://www.google.com/search?q=nes+u-force

    This is simply mapping certain motions (detected by the Kinect) into certain keyboard commands, just as the U-Force mapped hand motions to NES buttons. Note that the U-Force was universally rated among the worst controllers and peripherals of all time.

    It would be cool if your mage could throw a fireball with a hadoken gesture, but this is currently just "move left arm down to press 1" and "lean forward to press Up".

  43. Here comes full-body RSI by cavebison · · Score: 1

    Seriously, *leaning forward and backward* to control something? Raising your entire arm? Well, I can see how this would help to *reduce* the time kids play games, which is probably good, but completely unrealistic. I can see law suits (in the US of course) related to RSI injuries or just back pain from playing like that.

  44. Re:reducing childhood obesity through healthy gami by stewbacca · · Score: 1

    And in the meantime, the WoW kid is learning essential technology skills.

    Anyways, my kids do both. It's not an either/or proposition.

  45. Re:reducing childhood obesity through healthy gami by stewbacca · · Score: 1

    what does it mean?

    You secretly love Apple.

  46. Re:reducing childhood obesity through healthy gami by Anonymous Coward · · Score: 0

    That is quite possibly the worst sounding food I've ever heard of. Even Balut can't compare to that.