Slashdot Mirror


Microsoft Working On Motion-Sensing Camera For the Xbox 360

The Wall Street Journal reports on the motion-capture technology Microsoft is rumored to be working on for the Xbox 360. "Unlike the Wii, the Microsoft camera won't require users to hold any hardware to control on-screen action, the people familiar with the matter said. The camera would sit near the television and capture when players move their hands, legs or head." The Guardian Games Blog points out that we've gotten a look at this technology before, from a company called 3DV, which was reported to be talking with Microsoft earlier this year. Many expect the specifics of this technology to be revealed at E3 early next month.

68 comments

  1. Hmm by u38cg · · Score: 2, Informative
    --
    [FUCK BETA]
    1. Re:Hmm by 91degrees · · Score: 2, Insightful

      I never realised the eyetoy was a 3D camera.

    2. Re:Hmm by nizo · · Score: 3, Funny

      They tried selling 2D Eyetoys but people had a hard time picking them up.

    3. Re:Hmm by Anonymous Coward · · Score: 0

      I never realised the eyetoy was a 3D camera.

      I'd like to know what a frackin' 2D camera is. What the frack is a 2 frackin' D frackin' camera? felgercarb!

    4. Re:Hmm by powerlord · · Score: 1

      Exactly what I was thinking.

      A "more recent" example is the PS3's "Eye".

      Its very poorly supported, and provides nowhere near the same level of control as a Wii-mote (let alone 4 of them + nunchucks).

      On the other hand, it provides Video-Chat (something Nintendo will probably never offer), and when combined with some of their "Interactive art" ideas, the PS Eye kept a bunch of kids very occupied during my last party. Amazed the heck out of my wife. :)

      --
      This space for rent. All reasonable inquiries will be entertained at proprietors discretion.
    5. Re:Hmm by EXTomar · · Score: 1

      http://kotaku.com/5041543/pet-ownership-and-you-eyepet-screens-surface

      Unfortunately their images are down but I bet you can find video on youtube about it. Its a very compelling demo where it took nothing more than the EyeToy to interpret your moves in 3D to interact with virtual pet. The question is how much of it was smoke/mirrors/vaporware.

    6. Re:Hmm by djupedal · · Score: 1

      If it sounds familiar, it's because MS is still fishing for ways to market 'Surface', that big-ass table that many people mistakenly believe uses touch-tech, when it actually uses motion-detecting cameras under the glass/inside the BA table.

    7. Re:Hmm by Anonymous Coward · · Score: 0

      I never realised the eyetoy was a 3D camera.

      If you mean a camera that takes a 3-D image, you are correct. And neither is this.

      Unless you are claiming that microsoft has invented a Holo-recorder.

      All this is, is a normal camera with some extra processing software. You could do it all with an eyetoy, or even a normal webcam if you want to.

  2. Unfortunately... by rackserverdeals · · Score: 4, Funny

    They're going to have to wear a black leotard with whit ping pong balls on it as they jump around....

    and in many cases, people don't want to see that.

    --
    Dual Opteron < $600
    1. Re:Unfortunately... by clickclickdrone · · Score: 1

      >and in many cases, people don't want to see that.
      Speak for yourself!

      --
      I want a list of atrocities done in your name - Recoil
    2. Re:Unfortunately... by PIBM · · Score: 1

      The biggest problem I can see is that the only light source will be the viewing medium in many cases, which will most probably be causing the camera to struggle. The second one is the color of the people playing, vs the background color, if there's even enough light (and that it's not too modulated by the lighting coming from the tv..)

      I'll believe it once I test it ;)

    3. Re:Unfortunately... by rackserverdeals · · Score: 1

      could be IR? Even cheap digital cameras can work well as IR cameras. Just remove the IR filter. Maybe replace it with a filter that only allows IR light.

      Then you can also use a controller with it that has IR LEDs in it as well.

      Maybe it's a conspiracy by the paint industry. They have too much leftover green pigment?

      --
      Dual Opteron < $600
    4. Re:Unfortunately... by ozmanjusri · · Score: 1
      Speak for yourself!

      Ballmer will be demonstrating.

      Does that change your mind?

      --
      "I've got more toys than Teruhisa Kitahara."
    5. Re:Unfortunately... by clickclickdrone · · Score: 1

      You totally won that one dude.

      --
      I want a list of atrocities done in your name - Recoil
    6. Re:Unfortunately... by Anonymous Coward · · Score: 0

      Depends, will the chair have ping pong balls taped to it too?

    7. Re:Unfortunately... by Pinky's+Brain · · Score: 1

      The 3DV camera uses IR, it emits 2 short duration IR pulses. The first is used to measured the reflectance of the surfaces at each pixel, the second is gated by an extremely fast shutter in front of the camera.

      By comparing the two values the distance to objects can be computed for each pixel.

  3. The real question by mc1138 · · Score: 1

    Will the camera also record so people can post videos of themselves failing around online?

  4. Should be lots of fun to watch... by __aarvde6843 · · Score: 1

    One already looks quite idio^H^H^H^H funny when playing wii with just one (or two) remote(s)... Imagine if you have to wiggle your whole body to play a game. Hi hi!...

    1. Re:Should be lots of fun to watch... by tepples · · Score: 1

      One already looks quite idio^H^H^H^H funny when playing wii with just one (or two) remote(s)... Imagine if you have to wiggle your whole body to play a game.

      Before there was the Nintendo Revolution (sold as "Wii"), there was the Konami Dance Dance Revolution. That requires moving the whole lower body. And even before that, there was Nintendo Dance Aerobics.

    2. Re:Should be lots of fun to watch... by Divebus · · Score: 1

      Hi hi!...

      The YL already thinks you're a juvenile - wait 'til she watches you QSY around the living room like an idiot.

      --

      Most of the stuff on /. won't survive first contact with facts.
    3. Re:Should be lots of fun to watch... by bishiraver · · Score: 1

      And even before that, there was Track & Field for the NES.

    4. Re:Should be lots of fun to watch... by JustOK · · Score: 3, Funny

      And even before that, there was Track & Field for the, you know, field with the track.

      --
      rewriting history since 2109
    5. Re:Should be lots of fun to watch... by pandrijeczko · · Score: 1

      You've should see my missus playing Ten Pin Bowling on the Wii - the Wii being the only computer game device she has ever used in the 15 years I've known her.

      She takes a run up from the other side of the lounge and everything... the funny thing is that doing it this way she manages strikes just about every time and thrashes me completely at it. :-(

      --
      Gentoo Linux - another day, another USE flag.
    6. Re:Should be lots of fun to watch... by __aarvde6843 · · Score: 1

      If you get this new one, you'll have to start doing the same, m8! ;)

  5. Face Recgonition and Motion Sensing by MoldySpore · · Score: 2, Interesting

    This is actually a fairly cool bit of technology. My girlfriend recently got a crazy expensive webcam for herself. I don't know the model # off the top of my head but it is the one of their upper level models that has the Carl Zeiss Optical technology in it. Bundled with the camera comes face recognition and motion sensing software. It locks in on her face and when she moves around it follows her face so that she is never out of frame. It is actually quite accurate and rarely loses track of her.

    Not sure how much people who would be using this with the XBOX would be moving around, but it is generally a pretty neat tech.

    --

    "I hope you know how very lucky you are to know me, because I am so incredibly incredible."

    1. Re:Face Recgonition and Motion Sensing by clickclickdrone · · Score: 1

      Dude, it's not her face you want it locked on...

      --
      I want a list of atrocities done in your name - Recoil
    2. Re:Face Recgonition and Motion Sensing by MoldySpore · · Score: 1

      Touche, and it normally isn't ;) But for the context of this article that seemed kinda moot. Webcams have been trained in on other body parts for ages now. Perhaps they need some sort of other kind of "recognition" options as well?

      --

      "I hope you know how very lucky you are to know me, because I am so incredibly incredible."

    3. Re:Face Recgonition and Motion Sensing by caffeinemessiah · · Score: 2, Interesting

      It locks in on her face and when she moves around it follows her face so that she is never out of frame. It is actually quite accurate and rarely loses track of her.

      From a video processing point of view, this is not too hard when pretty much the full frame is filled with one prominent face, which is looking head on at the camera and usually not too far from it. Playing video games is a whole different cup of tea, and some of the reasons why this might not work so well are:

      1. You're usually very far from the screen, so the face/body is less evident in the scene, although this isn't a huge problem.
      2. There are usually people sitting next to you on the couch, so the algorithm has to keep track of multiple faces/bodies and track only the relevant one (or track as many people as are playing). This is much harder to do accurately and continuously.

      Well then again, it might work well on that massive, 8-core Cell proces---oh wait, that's the PS3.

      --
      An old-timer with old-timey ideas.
    4. Re:Face Recgonition and Motion Sensing by Xest · · Score: 1

      Even fairly cheap Logitech ones have been able to do this for a few years, but not only that they can overlay your face with rendered characters also so that you can have, say, an aliens head whos eyelids blink when yours do and whose head tilts and turns with your and whose mouth and expressions are mapped to yours. Effectively it recognises key points on your face that define expressions and maps them to a 3D rendered facial model - everything from aliens to dinosaurs to sharks. It can also apply overlays to your face, like drawing a moustache, glasses or a hat in the correct place on your face as you move around.

  6. Powerglove 2009 by senorpoco · · Score: 1

    This will undoubtedly join the pantheon of stupid gaming ideas, alongside the Virtuaboy and PowerGlove

    1. Re:Powerglove 2009 by bishiraver · · Score: 1

      But-but... it's so...BAD!

  7. The reason this will work and Eyetoy didn't? by Zarf · · Score: 1

    I think the reason this will work when the eyetoy didn't will boil down to subtle differences and the fact that it's on an XBox and not a PS2. The XBox has a pretty good following and if M$ can manage to properly market the device (as Nintendo did the Wii) I think they'll have enough success to keep the top slot a while longer. However, what they're working on has been in the lab for at least a decade now see BLUI for example... and that has nothing to do with Microsoft.

    --
    [signature]
    1. Re:The reason this will work and Eyetoy didn't? by KDR_11k · · Score: 1

      Wait, you point at the 360's following as the reason it'll do better than the EyeToy? You realize the PS2 had about 5x as many users as the 360?

      --
      Justice is the sheep getting arrested while an impartial judge declares the vote void.
    2. Re:The reason this will work and Eyetoy didn't? by Zarf · · Score: 1

      Dude, nobody's developing for the EyeToy right now. If this works it will be because of Microsoft marketing mojo and a few dozen game developer death marches. I actually would rather think that M$ is going to choke and die on this idea but I can't see it happening. They have an amazing amount of loyalty in their user base right now. It's actually almost Apple like.

      --
      [signature]
  8. latency by spyrochaete · · Score: 1

    I've never used Eyetoy or other webcam-based games, but somehow I don't think it could afford the same degree of responsiveness of the Wiimote. You can play rhythm-based games on Wii but I doubt this would be possible with a webcam. This isn't necessarily a bad thing but it does limit its possible uses.

  9. Warning! by Anonymous Coward · · Score: 2, Funny

    You are wanking to unlicensed porn!

    [buy license and continue playing porn] [abort wanking]

  10. Too bad it's bound to fail in the market by Turken · · Score: 3, Insightful

    Two major problems with this possible system: First, it's just a camera. Without a full set of buttons on a controller that can be operated one-handed (or two hands with independent motion), you're stuck with waggle-only games and the Wii has already shown us how bad (or just plain frustrating) those can be.

    Second, at this point in the console life cycle it's just another add-on with potential for a niche market at best. Unless there is massive developer support and or a large pack-in campaign, there simply won't be enough people with the hardware to justify developing many games for is.

    So basically we're looking at another eye-toy, albeit one that can work in most rooms. Maybe Microsoft can come out and really surprise us with something amazing to add to what's already been tried before, but I'm not keeping my hopes too high for this one.

    1. Re:Too bad it's bound to fail in the market by Anonymous Coward · · Score: 0

      No; wrong; this will not fail. XBox Live now replaces phone sex. Move parts of your body, etc. - you will see that this will take off when the right "game" gets published for it.

    2. Re:Too bad it's bound to fail in the market by Anenome · · Score: 1

      Worse than that, I don't see how it can be reliable. Visual systems will have to go a much further way before they're going to be reliable enough to serve in this capacity. If this is their answer to the Wiimote I think they're in for a surprise next console generation. And furthermore, some people like to play in the dark, and some will be in bright environs, or even with super-bright windows behind players.

      --
      "I Don't Have Enough Faith to be an Atheist"
  11. What about the existing 360 camera? by Shrike82 · · Score: 1

    Someone bought me the Xbox camera already. Now I'm expected to buy anther camera so I can waggle my arms about like a moron to make something happen on screen?

    I think perhaps Microsoft are forgetting two key points here. The 360 has a particular set of users that are unlikely to be that enthused about a motion capture camera. They can already go out and buy a Wii if they prefer to make their input without using a normal controller. Couple this with the fact that motion capture through a single fixed camera probably isn't going to be as spectacular as their press releases are going to make it sound. For these reasons and more, I'll not be putting this on my Christmas list thankyou very much.

    --
    You can advertise in this sig from as little as £99.99 a month!
    1. Re:What about the existing 360 camera? by 91degrees · · Score: 2, Insightful

      The 360 has a particular set of users that are unlikely to be that enthused about a motion capture camera. They can already go out and buy a Wii if they prefer to make their input without using a normal controller.

      That's kinda the point. MS want people to buy an XBox when they might buy a Wii instead.

    2. Re:What about the existing 360 camera? by Shrike82 · · Score: 1

      I really doubt that this camera-based input system is going to be as innovative or ground-breaking as the Wiimote. And hasn't everyone in the world already bought a Wii anyway?

      Seriously though, I honestly believe that they're targetting the wrong group. Hardcore gamers aren't going to like an imprecise control system (and they'd have to come up with something unbelievably ahead of the current state of the art to get decent controls from a camera) and casual gamers probably aren't going to shell out for a 360 when they already own a Wii. The small niche of people who are yet to buy either console and might be pursuaded by this makes for a small market.

      --
      You can advertise in this sig from as little as £99.99 a month!
    3. Re:What about the existing 360 camera? by Agent+ME · · Score: 1

      Yeah, didn't Microsoft already release a camera like the EyeToy for the 360 and a few games that used it? Maybe you and I have slipped into an alternate reality where they haven't yet?

      Or is there something radically new about this newer camera?

    4. Re:What about the existing 360 camera? by Shrike82 · · Score: 1

      I can only imagine that this new camera has better resolution, or some built in hardware for motion capture. Either that or M$ are cashing in.

      As a fellow Xbox Live Vision camera owner, how much do you think it sucks on a scale of 1 to 10? I have to go straight for the 10...

      --
      You can advertise in this sig from as little as £99.99 a month!
    5. Re:What about the existing 360 camera? by 91degrees · · Score: 1

      I guess the hardcore gamers are going to buy a 360 no matter what. They're already being marketed to.

      Casual gamers might not own a Wii yet, (they are still selling after all) and the XBox 360 is cheaper. Also a better choice if you like to dabble in online gaming but can't quite justify the price for that alone.

  12. No good. by Millennium · · Score: 2, Interesting

    There's a reason that even Hollywood still relies on external sensors for motion capture: machine vision is decades away from being able to do stuff like this. There is simply no way this will be any good, but then, I think that's part of the point: reinforce the 360 fanboys' perception that motion is bad by giving them a bad controller for motion.

  13. This headline looks really familiar, oh wait by Anonymous Coward · · Score: 0

    It's exactly the same as this one, posted yesterday.

    http://www.gizhq.com/2009/05/12/microsoft-working-on-a-motion-sensing-camera-for-the-xbox-360/

  14. This could be a success by 91degrees · · Score: 1

    The Eyetoy may not be an absolute killer ap, but games for the device do actually sell pretty well. They're popular with kids and kinda fun.

  15. Its the software and the API by Midnight+Thunder · · Score: 1

    Sony already has this in the form of the EyeToy. The issue here is not so much the camera, but the software behind it and more importantly how easy it is for games developers to take advantage of the intelligence provided.

    There are plenty of examples of motion detection with cameras, but getting them to detect multiple moving objects, varying lighting conditions and so on is the challenge. I am not saying Microsoft will not succeed, I am simply saying that in many ways getting this to work perfectly is much more challenging than something like the Wiimote or the Wii Balance Board.

    --
    Jumpstart the tartan drive.
    1. Re:Its the software and the API by Pinky's+Brain · · Score: 1

      If Microsoft really is using the 3DV camera then it's not like the eyetoy, it measures the time of flight of IR from camera to surface to sensor for each pixel. It captures a depth map, lighting conditions are irrelevant for this function.

    2. Re:Its the software and the API by Midnight+Thunder · · Score: 1

      it measures the time of flight of IR from camera to surface to sensor for each pixel.

      Light source type can still have an impact. If you have tungsten lamps, halogens or any other strong source of IR, it can mess with with this. I discovered this the hard way with the Wiimote.

      --
      Jumpstart the tartan drive.
    3. Re:Its the software and the API by Pinky's+Brain · · Score: 1

      The measurement is done within a couple of nanoseconds ... any IR light source which is approximately constant during that time will not affect the it.

    4. Re:Its the software and the API by Pinky's+Brain · · Score: 1

      Well, unless the light is strong enough in comparison to the light emitted by the camera that it will saturate the ADC.

  16. The motion of the XBox through the window by David+Gerard · · Score: 0

    It can sense the motion of the XBox through your window when you get another red ring. Sorry, E74.

    That said, twenty XBox lifts every morning will do waaay more for muscle-building than Wii Fit. Thus proving Microsoft's inherent superiority!

    --
    http://rocknerd.co.uk
    1. Re:The motion of the XBox through the window by Anonymous Coward · · Score: 1, Interesting

      David Gerard's "Easy Does It" Comedy play book:

      1) Choose a target.
      2) Pick a negative trait or story about that target.*
      3) Spin the negative into a positive.
      4) Brag about the positive to appear like a zealot/troll.

      Works every time, if the reader's IQ is under 90.

      *Negative stories can easily found at BoycottNovell.com, provided by Roy Schestowitz, or from Twitter's journal. Both authors are personal friends of David.

  17. sweet by Dyinobal · · Score: 1

    not only will I be able to tea bag noobs in halo I can give them a cam show while doing it!

  18. I don't understand... by PPH · · Score: 1

    ... this concept of motion in front of a TV set. I thought television's primary application was to prevent all physical activity on the part of the viewer.

    --
    Have gnu, will travel.
  19. tronguy by Anonymous Coward · · Score: 0

    I guess the tronguy will get lucky with this device http://www.tronguy.net/

  20. it seems like this by nimbius · · Score: 1

    isnt really something geared too well for xbox games...killers like halo and crew are not going to find much use i dont think

    where was nintendo when it came to this? id love to see something like this for wii.

    --
    Good people go to bed earlier.
  21. Oh dude, no way! by Anonymous Coward · · Score: 0

    You mean soon I'll have to actually MOVE to play video games?

  22. WSJ reporting rumors again? by ClubStew · · Score: 1

    I remember sometime back on /. when WSJ was reporting rumors and the statement was basically the same: WTF WSJ? I thought they were supposed to be more tactful than that, or are they just trying to cope in a world where print is quickly dying (and the economic situation doesn't help either)?

  23. Actually, the EyeToy isn't that bad. by Dr.+Manhattan · · Score: 1

    I've never used Eyetoy or other webcam-based games, but somehow I don't think it could afford the same degree of responsiveness of the Wiimote.

    Actually, the EyeToy is pretty good. The minigames it came with work quite well. And as to rhythm-based games, many of the DDR games can optionally add hand-movements to the dance, and that's a challenge (at least for me :-> ) but not because it's not sensitive enough. The game Antigrav is right on the edge of what the EyeToy can do, but if you have good lighting and a neutral background to provide good contrast, it's just fine.

    The main problem is when you've got multiple people in-frame - that can confuse things. On the other hand, for many of the games that just means cheap co-op multiplayer. :->

    With a higher-resolution camera and the 360's CPU, more advanced stuff should be possible... but then, Sony could do the same things.

    --
    PHEM - party like it's 1997-2003!
  24. They've tried and failed at this before by Anonymous Coward · · Score: 0

    Microsoft already released a camera more than two years ago. It even came with a came that was "motion controlled", although it was pretty flaky.
    Wikipedia Entry

  25. Spam and hosting costs by Anonymous Coward · · Score: 0

    5) Profit.

    His "comments" here are mostly thinly disguised promotions for his monetized blog, and therefore can be qualified as nothing more than spam. The burning question on everyone's mind is, I think, whether or not it actually works. Hosting lemonparty.org (do an nslookup on it and davidgerard.co.uk) must be expensive, so a secondary source of income must be quite attractive to him.

  26. Not surprising by jalet · · Score: 1

    While the camera in the wiimote points to the screen, Microsoft camera points at you !

    Who knows what they'll do with the pictures ?

    --
    Votez ecolo : Chiez dans l'urne !
  27. Maybe 3DV can finally ship... by Hotsphink · · Score: 1
    As a former employee of Reactrix Systems (may it rest in peace), I know something of this space. We had this working a few years ago (ok, we were on Linux and using the Tyzx 3D camera.)

    I'm happy to see that MS bought 3DV. 3DV has been promising that their camera will be available at scale for years. I talked to them at GDC a year and a half ago. "It'll be out this summer." "Who's your manufacturer?" "Oh, we don't have one yet. We'll just get someone in Taiwan or China to do it. Manufacturers are a dime a dozen."

    So are companies with unbuildable products. I had to resist the urge to laugh in his face -- they didn't have their sh*t together in February and they'd have product on the shelves in the summer? I pretty much gave up hope on them then.

    Which is too bad. They have a nice product -- not as good as Tyzx or PrimeSense, but theoretically it could be far less expensive.

    Don't think of the EyeToy. That's a simple 2D differencing system, and not a very good one. I actually think it's a good product overall -- not enough so that I'd bother to buy one, but you could have fun with the right content. The vision system could be done better even with the harsh constraints (working in just about anyone's living room is surprisingly difficult.) But 2D images are fundamentally limited.

    A depth-sensing camera like the Z-Cam, Tyzx, or PrimeSense can pick out gestures in front of your body, it can measure direction and acceleration in 3D, and it can pick players out from the background far better.

    At the same time, our intuition was (and our experience found) that trying to convert camera input into controller input is just a bad idea. You don't want this for playing Halo 3. You need games built for camera input. It's fun for more than games, too -- we prototyped some nifty photo, video, and 3D model interfaces.

    One of our most eyecatching prototypes was a light saber game where you could slice through oncoming hordes of robots. The video is dark and not very well done, sorry.

  28. Microsoft Innovation! by Anonymous Coward · · Score: 0

    Wow! I also hear Microsoft is working on a file system...that's a DATABASE!