Slashdot Mirror


The Inside Story of Microsoft's 'Project Natal'

Lanxon writes "Wired has published a lengthy behind-the-scenes feature documenting the inception, development and technological struggles of Microsoft's Project Natal, now known as Kinect. The feature is the result of conversations the magazine had with a number of key developers and researchers behind the project, and unprecedented access to Microsoft Research in a number of countries, over the course of three years."

21 of 130 comments (clear)

  1. Re:Waste of R&D dollars, if you ask me by Anonymous Coward · · Score: 2, Insightful

    Actually most projects in Microsoft Research never come close to making any money, they are just meant to be feeder projects for future products. The fact that this one came to market so quickly is really unique.

    Most people forget how much money some of the big companies like Microsoft and IBM put into pure research efforts (i.e. no immediate plan for a ROI)

  2. Re:Waste of R&D dollars, if you ask me by Darkness404 · · Score: 2, Interesting

    Exactly, just about every single console has tried to do what Kinect is trying to do.

    The Dreamcast had the Dreameye

    The PS2 had the EyeToy

    The PS3 has the PlayStation Eye

    Even the 360 has the Xbox Live Vision


    All of them failed to change gaming as we know it. Yeah, the EyeToy had a few games that made use of it, yeah, they were fun in a weird way but they were just tech demos.

    We've been trying the camera + console combo for a decade and none of them have really changed gaming... at all. Perhaps Kinect will change that, but chances are, its just hype. I mean, has anyone ever -used- Kinect except for a few people? Plus, attempts to "revitalize" a console midway through its lifespan have historically failed, the only "success" would be the expansion pack for the N64 the rest (SegaCD, Sega 32x, etc.) have all spectacularly failed.

    --
    Taxation is legalized theft, no more, no less.
  3. Re:Waste of R&D dollars, if you ask me by mSparks43 · · Score: 2, Funny

    They should get Carol Vorderman to do the advert. "Now you can consolidate all your super sucky controllers into one, easy, Mega sucky interface"

  4. Re:A lot of hype... by hoshino · · Score: 2, Informative

    The Eye Toy for PS2 is actually one of the most successful console accessories ever, selling 10.5 million units worldwide despite a slow start. Apparently it was actually novel and useful enough for its time to generate grassroot interest. The failure you are looking for is The Eye for PS3.

  5. Re:Waste of R&D dollars, if you ask me by 1000101 · · Score: 2, Informative

    My son will be 6 years old tomorrow. This is the first thing I'm getting him for Christmas. We don't own a Wii, and this looks more fun anyway. I'm just one person of course, but I'm sure there are plenty of people out there in the same situation as myself.

  6. “History is about to be rewritten"?? by esaulgd · · Score: 5, Insightful
    From TFA:
    “Since the dawn of time, humanity’s long journey has led us to countless discoveries, Yet with each leap forward for civilisation, more people have been left behind. But our quest has taken us to a completely new horizon. History is about to be rewritten. This time human beings will be at the centre -- and the machines will be the ones that adapt. After five million years of evolution, is it possible that the future of humanity is humanity itself?”

    That the article repeats verbatim such a quote from Microsoft's presentation without even a slight nod to the gross self-aggrandization clued me to the fact that the whole piece is yet another corporate advertisement disguised as news.

    I mean, in addition to the whole story starting with an emergency meeting on mid 2007 about the need to "reimagine a new direction for the Xbox" yet failing to point out it was all due to the runaway success of the Wii. It actually sticks out like a sore thumb to see these VPs panicking about something that the article refuses to acknowledge exists.

  7. Re:Waste of R&D dollars, if you ask me by AnonymousClown · · Score: 2, Interesting

    Most people forget how much money some of the big companies like Microsoft and IBM put into pure research efforts (i.e. no immediate plan for a ROI)

    Forget? Is there anything to really forget? Back in the day, IBM did quite a bit of pure research and now, occasionally you'll see something about them writing "IBM" with atoms or making a computer that's really fast but nothing like the research they did.

    BTW, nothing will ever beat AT&T Bell Labs - especially for the pure research they did back when they existed - all that's gone now.

    Basically, a guy like William Shockley wouldn't have a chance in this day and age.

    --
    RIP America

    July 4, 1776 - September 11, 2001

  8. Re:Waste of R&D dollars, if you ask me by cjcela · · Score: 2, Funny

    Make your son a favor, and give him something to play outside instead of a gadget.

    Maybe you can get the Kinect thing for yourself, as well...

  9. 3DV Systems by Mathinker · · Score: 2, Informative

    3DV Systems, an Israeli company, so it seems: http://www.engadget.com/2009/06/03/microsofts-project-natal-roots-revealed-3dv-systems-zcam/

    Probably find more info with a search on "3DV Systems" on the GOOG.

  10. Re:A lot of hype... by riskeetee · · Score: 3, Informative

    Yes. A friend (who works at MS) has a demo unit. This blows away the Nintendo Balance Board, because you can actually JUMP! It's better than the Sony Move, because you don't need a stupid looking controller to play it. It's very accurate at reading your motions in a 3d space. Microsoft has a winner on their hands with the hardware. If they can get some good titles behind this, it's going to be awesome.

  11. Why Does This Seem Familiar? by EXTomar · · Score: 2, Insightful

    Why does Kinect seem familiar? Microsoft saying "It will change the industry" and "Big players are developing it" and "You'll wonder how you ever did anything without it!" and "Everything will change after this". Oh yeah, this is what they said with Windows Mobile 6.

    The more reports I get back the more it seems like just with Windows Mobile 6 that marketing is over promising features. That isn't to say Kinect is "snake oil" because of a lot of it does seem to work but that it is rough...."rougher" than they want to let on. So we'll get a big advertising blitz, Microsoft will declare it was a huge success, and then summary die because it is expensive and never quite work as smooth as they advertised while the competition runs wild. All of this is like WinMo6.

    Anyhow, there is some merit to the tech but it feels like it is going in the wrong direction. Its like the belief one can effectively replace a keyboard with voice recognition. VR is useful in itself but not as a keyboard replacement! As an HMI issue, gesture controls found on Wii "work" because the interface is simplified not because of waggle. Replacing waggle sticks with Kinect without doing the requisite "simplification" is going to be a disaster. I wish they would abandon schemes like "replacing the controller for games" that are more smoke and mirrors than practical execution. Go with practical stuff like if my console notices I put the controller down to answer the phone, door, kids jump in my lap, or whatever, pause the game. If the console notice I'm no long in front of my TV for an extended period of time, go into hibernate mode. Stuff like this is more useful than trying to figure out how build a fighting game by waving my arms and kicking with my legs.

    But in any event, $150us is too much for all of it. If it was built in at the start that would be one thing but it is too late now.

  12. You Should Be Criticizing The Shoddy Tech by RingBus · · Score: 5, Interesting

    Microsoft was caught faking their demos for their Eye Toy style motion controls for the past two E3s.

    And first had reports constantly talk of horrible lag between arm movements and response.

    You can't play games while sitting down.

    You need to have a relatively large area completely clear in whatever room you are using it in.

    There are lighting issues that cause the system to have trouble recognizing motion.

    There are clothing issues that cause the system to have trouble recognizing motion.

    It doesn't recognize fine motions like finger actions.

    It only supports two players.

    It should be obvious why Microsoft was forced to fake their demos and so far there has been almost zero real world demos outside of carefully controlled showings with people Microsoft is certain are going to hype the product.

    Not that any of that really matters. There isn't any game even remotely interesting or fun that Microsoft has show for the system. When Nintendo showed off the Wii they were confident enough to let everyone at the very first E3 where it was shown play it and had games that both gamers and non-gamers really wanted to play.

    Most likely the only people who will end up buying this shoddy tech from Microsoft are the same ones who jumped on the dead HD-DVD format.

    1. Re:You Should Be Criticizing The Shoddy Tech by Thud457 · · Score: 3, Funny

      Dear multibillion dollar corporations: with today's abysmal economy, I'd sure like to get in on some of that lush gelt. Normally, I troll for the lulz, but I'll be more than happy to shill for the $$$$<--(that's four monies, there...)

      --

      the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

    2. Re:You Should Be Criticizing The Shoddy Tech by cbhacking · · Score: 4, Informative

      I take it you didn't get to PAX this year... lots of Kinect demos (both by MS and by third-party developers). They all worked pretty well. Some had huge lines of people waiting to play. They all had people watching. Everybody walking away afterward looked excited.

      Don't get me wrong, Kinect is far from perfect and the cost is substantial, but the system most assuredly works and people are hyped for the games.

      --
      There's no place I could be, since I've found Serenity...
    3. Re:You Should Be Criticizing The Shoddy Tech by Xest · · Score: 2, Interesting

      I agree, I'm what would I suppose be categorised as a hard core gamer, so personally for me Kinect's launch titles provide nothing compelling enough for me to be interested in buying it either.

      Despite that, the GP's comments are complete FUD, the tech itself seems fine. As I mentioned in another post in reply to Pojut's original comment, I'm a little dismayed that they dropped the quality of the camera so that it can no longer handle hand/finger gestures, which would've been great for FPS games being able to issue commands to AI team mates and such, but other than that it still works pretty much as advertised, you don't need to be stood up (well, unless the game requires it of course- i.e. dance games!), it can easily cope with more than 2 players etc.

      It does provide a dimension that Move and the Wii can't at least which is where it may shine- because it's controllerless you can use a controller with it, this means that in games like Guitar Hero it'd now be possible to have players actually move around whilst playing the Guitar, or in games like Lips have people sing into the Microphone and dance as well- not my sort of thing really but I can see how it adds potential we don't yet have in gaming. Whether the potential will ever be reached is a different story of course- for me despite being an early adopter of the Wii, I got it on releaese day, that never ever actually reached it's potential either. I found nearly all the games dull and boring. I'm concerned that Kinect will suffer the same fate- no real innovation to really draw the new control scheme into games with deep mature storylines.

      As with everything, all we can really do is wait and see I suppose!

  13. 3rd try's a charm? Kinect: The 3rd Wiimote killer by pizzach · · Score: 2, Insightful

    I hate to sound cynical, but this will only be the 3rd Wiimote killer since the 6-axis took it's aim. With all of Kinect's extra features over the de facto, it should fit really nicely next to all of the iPod-killers of yor.

    The Kinect is the Firewire of the Firewire-USB war. Overly expensive and unsupported compared to it's contemporary cousin even if it may have better technology. It only takes a (USB2-style) revision to make the things Kinect has moot and the populace moves on...

    --
    Once you start despising the jerks, you become one.
  14. Embarrassing Kinect demo on German TV show by mick232 · · Score: 3, Funny

    Yesterday I watched a TV show on German TV in which they used the Kinect system. It was broadcast on a major channel watched by millions. Two players had to play against each other in a quite unspectacular game. It was embarrassing, both due to the boring gameplay and the technical weaknesses of the system. During the first game, suddenly the split-screen switched to a single screen such that only one player could see his avatar. Nobody knew why and the TV show host quickly reacted and said "well, now you had a training run". After the second run one of the players complained that his moves were not recognized at all. He kept jumping all the time but the cameras obviously did not capture these jumps.

  15. Re:Waste of R&D dollars, if you ask me by Xest · · Score: 3, Insightful

    To be fair, I think things like Move and Kinect are really just ramping up for the next generation of console equipment that will have this stuff as standard. I doubt they're counting on doing anymore than breaking even, if that for now. Getting developers onboard and used to the tech so that they could really push it next gen is probably a good thing too- look how many 3rd party developers really struggled to take advantage of the Wii, most stuff that's been churned out since release has been utter crap, and it's taken a while to get some good 3rd party stuff out there.

    There was a story some weeks ago about how Natal could previously even read sign language, and detect finger gestures, but to make the equipment fit in the $150 price range they switched to a lower resolution IR camera. I'd imagine they'll put the higher resolution back in for the next gen console so FPS players can issue commands with hand gestures and that sort of thing, which they could've done this time if they'd made Natal prohibitively more expensive. I guess the technology is too new and expensive to really push it to it's limits right now, but by the time the XBox 720 or whatever comes out it may not be.

    I'm also not sure at least in the case of Natal (I don't know about Move) that the R&D will be wasted even if it flops in gaming. I'd imagine hands free interfaces are something Microsoft is hoping to capitalise on elsewhere in the future. It's like things like multi-touch and gesture recognition, it's not new, but it's really come into it's own in recent years finding it's way on mobile devices and becoming a must have feature. It may be that Natal wiill find it's niche in for example TVs, to provide hands free control of them or something like that.

  16. Data point of 1 by russryan · · Score: 2, Interesting

    I was in Best Buy last weekend and they were demonstrating the Kinect. My 9 year old daughter, who doesn't like to play console based video games, started playing one of the demos. It was sort of like Breakout, but you kicked or punched the balls instead of using a remote. I had a hard time getting her to leave.

  17. Re:Waste of R&D dollars, if you ask me by PaladinAlpha · · Score: 2, Insightful

    Sorry. Much falseness here.

    First of all, the on-board processor was dropped. Kinect places its entire processing load on the 360 (putting a 10-15 % load on the CPU).

    Second, the "regular camera" in it runs at 640x480 30Hz, which is bad enough, but the infrared projector runs at 320x240, which is abysmal and the reason the device cannot detect things like finger movements.

    The device is not ambitious at all; it's old tech. We've been doing depthmaps from two image sources for about as long as we've had cameras. The fact that Microsoft has made several cuts in hardware and functionality and is still pricing the device at $150 is disheartening, although not surprising given their pricing on things like proprietary hard drives.

    Basically, it's overpriced junk that could be not just matched but beaten on any computer or on the PS3 by two webcams, two microphones, and a 5k program (total cost: $60). I would applaud them for pushing development of userspace control, but what's far more likely to happen is this thing is going to bomb hard enough to scare investors away for the next thirty years. They are actually hurting the market.

  18. Re:Waste of R&D dollars, if you ask me by PaladinAlpha · · Score: 3, Informative

    On-board processor was dropped [citation needed]

    Here, here, here, and here.

    Depth camera runs at 320x240 so it can't detect fingers? Maybe not, but it's doing infinitely more skeletal recognition than Move is.

    Actually, Kinect only allows skeletal recognition for its own Avatars -- that functionality is not available to games developers. Both consoles are doing an equal amount of skeletal recognition in the SDK exposed to developers -- none.

    Not ambitious? PS3 or PC could do the same thing trivially with two cameras? OK, then why aren't they?

    Because, quite simply, everyone else knows it's not worth it. In fact, Sony was offered the Kinect technology and chose not to use it, specifically because they knew its marketability is limited.

    Sony has already tried the no-controller camera-driven games with the EyeToy, which bombed. There have been all kinds of toy programs using webcams, which are all forgotten. Adding a depth camera does not fundamentally change the interaction -- in fact, it barely affects it at all. In userspace, Kinect is EyeToy, is doomed. You cannot play engaging games without a controller.

    Overpriced? Perhaps, but I have a hard time believing that Microsoft is pricing it significantly higher than they have to - they want it to be a success and the know it's up against a less expensive competitor.

    If they cannot sell two cameras and a toy motor for less than $150 I'll eat my hat. Do you really believe, for instance, that they "can't sell" a 250GB hard drive for less than $129.99 when normal 250GB hard drives can be had for less than $50 (a third of the price, ultimately)?

    Basically, it sounds like you don't think they're going far enough, but I think if they went as far as you want them to they would completely price themselves out of the market. At some point you have to compromise ship something practical.

    If I put a box of trash up on eBay for only a 10% markup over what it all cost me, how many people do you think will buy it? The market doesn't care what you spent. It cares what the price is and what they get out of it. $150 is going to sail right over everyone's head. You may bookmark this post and refer back to it when the Kinect line is officially discontinued (I will give it say Summer of 2012, after Microsoft loses a lot of money, which is what their games division has been doing all along.)