Slashdot Mirror


Sony Demos Natal-Like Control System

An anonymous reader writes "It's not just Microsoft investigating full body, markerless motion capture. Sony has enlisted the help of Swiss firm Atracsys to develop similar technology. Sony has openly discussed the technology with New Scientist, and has realistic expectations for the new system — it can capture broad body gestures but not individual fingers. That's just one trade-off needed in order to develop a real-time system that anyone can use, according to a markerless motion-capture expert." It's still in the early stages of development, but the accompanying video shows the use of face-recognition software as well. The demo game has players moving their heads left or right to position their character, and then smiling to "catch" an object.

63 comments

  1. You Have To Be Joking! by Anonymous Coward · · Score: 1, Interesting

    Project Natal running on PlayStation 2 , 5 years ago

    http://www.youtube.com/watch?v=jYHr0I-iFHE

    What's next on Slashdot? Microsoft 'invents' open source software development?

  2. Sony by Anonymous Coward · · Score: 0

    Huh. Sounds grate.

  3. Sony. We Innovate! by Deathlizard · · Score: 0, Redundant

    So that means, not only are they going to rip off Nintendo, There going to rip off Microsoft too?

    So now the PS3 can tell you look like an idiot while swinging the lighted Bingo Dauber around. Nice.

    1. Re:Sony. We Innovate! by Nerdfest · · Score: 5, Insightful

      MS copied Nintendo Mii's with their avatars. Sony Copied MS with achievements. Sony Copied Nintendo with motion control (poorly). I'm hoping Nintendo copies MS's online play and friend system. As long as they can give us all a better gaming experience without getting their asses sued, I'm in favour of it.

    2. Re:Sony. We Innovate! by somersault · · Score: 3, Insightful

      Umm.. what's poor about Sony's motion control system? It's a lot more useful than the original Wii control system..? I'm looking forward to it anyway (and yes I have a Wii, but I got bored of it and started using my PS3 exclusively long before motion plus came along).

      --
      which is totally what she said
    3. Re:Sony. We Innovate! by somersault · · Score: 1

      Why else would they buy it? There are already camera games for PS2 and PS3, so what makes you think they wouldn't make use of this new stuff with the EyeToy?

      --
      which is totally what she said
    4. Re:Sony. We Innovate! by Anonymous Coward · · Score: 1, Insightful

      Sony has had camera control since the PS2. Sony actually DID innovate this time. Microsoft ripped them off.

    5. Re:Sony. We Innovate! by Anonymous Coward · · Score: 0

      rip off? what are you 10 years old?

    6. Re:Sony. We Innovate! by somersault · · Score: 1

      I just don't see how Sony + Camera + Gaming != PS3. Even the advertising stuff could be referring to the PS3, though I certainly hope not..

      --
      which is totally what she said
    7. Re:Sony. We Innovate! by androvsky · · Score: 1

      Ah, but since it was Microsoft that copied the eyetoy concept, we're all supposed to forget that the original ever existed. I'd think Slashdotters would know how this works by now... ;)

    8. Re:Sony. We Innovate! by CaptainOblivion · · Score: 1

      Wasn't the Sony ps2 the first major console to have this? (the eyetoy- I know it sucked, but the idea was there)

    9. Re:Sony. We Innovate! by religious+freak · · Score: 1

      I have very similar thoughts as the parent. The only difference is that I'm in favor of it

      --
      If you can read this... 01110101 01110010 00100000 01100001 00100000 01100111 01100101 01100101 01101011
    10. Re:Sony. We Innovate! by Anonymous Coward · · Score: 0

      I'm hoping Nintendo copies MS's online play and friend system.

      I think Microsoft has a patent on the annual fee.

    11. Re:Sony. We Innovate! by Anonymous Coward · · Score: 0

      Sony copied avatars aswell with home.

    12. Re:Sony. We Innovate! by ukyoCE · · Score: 1

      How do you think it's more useful than the Wii controllers? Eyetoy was a cute game but it doesn't seem anywhere near as useful to capture movement using a single camera (ie: no 3d movement) as using a controller. I'm sure at some point the two will be combined for some interesting effects, but the camera alone is very limiting.

    13. Re:Sony. We Innovate! by somersault · · Score: 1

      When I said "Sony's motion control system" I was referring to the one they demoed at E3, the one that uses a controller (or two controllers) in combination with EyeToy for full 3D positioning with "sub-millimeter accuracy". That system does all the things that I thought the Wii was going to be able to do, but didn't.

      --
      which is totally what she said
    14. Re:Sony. We Innovate! by Anonymous Coward · · Score: 0

      stfu

  4. Sony demoed this at the same time as Natal by SuperKendall · · Score: 3, Insightful

    Sony demoed this system at the same show Natal was announced at. Both Microsoft and Sony were trying to come up with answers to the Wii.

    Microsoft's system is, if you think about it, pretty clunky. It can't recognize fingers either (or it didn't at the demo).

    Sony's is a little better, in that at least you have a controller with real buttons to denote actions.

    But I think both, are in the end not as good as the Wii system, where you can sit on the couch and play if you want instead of requiring a rather large clear area right in front of the TV set, just where most people have coffee tables laden with remote controls and magazines...

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re:Sony demoed this at the same time as Natal by nine-times · · Score: 4, Insightful

      Yeah, maybe I'm wrong here, but I feel like this idea is about as overhyped as the idea of replacing your keyboard and mouse with a touchscreen.

      First, people have to realize that it won't be like sci-fi level virtual reality. You'll still be looking at a TV, so it won't be completely immersive. Just measuring body movement without a controller means no haptics or force feedback. Plus, game designers still aren't good a providing real freedom in games to "do what you want". Hell, even sandbox games usually only allow you a couple of pre-prepared actions in a walled-off world. Grand Theft Auto is nice enough not to have you running into invisible walls around their world, but they instead put you on an island in the middle of an infinite ocean.

      So the things people imagine don't quite work out. People imagine a sword fighting game, but forget that you won't feel the other fighter's block. People imagine a game where you can have realistic interactions, where refined and specific movements can make a meaningful difference in what happens in the game, but instead you're limited to a vocabulary of a couple gestures.

      Maybe these things are a stepping stone to something more, but I doubt I'll be ditching my controller anytime soon. There are probably also other techniques that are both easier to pull off and more effective at creating immersion. For example, imagine playing a FPS with a high-quality Wii-remote-like device and 3D head tracking.

    2. Re:Sony demoed this at the same time as Natal by HalAtWork · · Score: 2, Interesting

      Sony demoed this system at the same show Natal was announced at.

      No, what you're talking about is the dual wand system. This article is about a system that "uses stereo cameras to watch a player and, like a pair of eyes, to judge depth." It will probably be used for eyetoy-like games and other full body motion games.

      Personally I can't wait for the wand system for the pointer functionality, since RE5 will make use of it. It was pretty disappointing going from Resident Evil 4: Wii Edition to RE5, and always wished there was a Wii version this game. The version with the wand update will marry HD graphics with the most advanced control system for an RE game.

    3. Re:Sony demoed this at the same time as Natal by BillGod · · Score: 1

      I will be holding out till some one releases a holodeck!

      --
      MISSING - Sig file. 2 years old black and white and very funny. If found please email me.
    4. Re:Sony demoed this at the same time as Natal by da_matta · · Score: 1

      The point is not to be virtual reality, but rather "wiimote v2". I.e. it will allow new types of gameplay for casual gamers that don't enjoy (=can't handle) button mushing with a pad. It's MS's response/evolution to Nintendo's innovation on motion controlled gaming. It's not going to revolutionalize gaming, but it's big enough for Sony to realize they can't be only one without.

    5. Re:Sony demoed this at the same time as Natal by SuperKendall · · Score: 1

      Thanks, I had thought for some reason it was simply a refinement of the dual sticks thing.

      --
      "There is more worth loving than we have strength to love." - Brian Jay Stanley
    6. Re:Sony demoed this at the same time as Natal by complete+loony · · Score: 1

      imagine playing a FPS with a high-quality Wii-remote-like device and 3D head tracking

      ... combined with nvidia 3D vision. It's the perfect combo. You already need to wear funky glasses and have a usb dongle near the screen. Just put little led's in the glasses and a small camera in the dongle and the immersion would be complete.

      --
      09F91102 no, 455FE104 nope, F190A1E8 uh-uh, 7A5F8A09 that's not it, C87294CE no. Ah! 452F6E403CDF10714E41DFAA257D313F.
    7. Re:Sony demoed this at the same time as Natal by nine-times · · Score: 1

      Part of my point is that I think it's a mistake to believe the "next step up from the wiimote" = no controller. The wiimote gave some feedback both in terms of sound and vibration, and also allowed relatively good control of some things with relatively subtle movement. Yes, people got up and jumped around and looked like idiots, but if you wanted to you could play Wii Sports sitting comfortably on your couch, barely moving around.

      You can make things easier to control and more immersive through other techniques. For now, I don't think getting rid of the controller will be more than a poorly supported gimmick.

    8. Re:Sony demoed this at the same time as Natal by IrquiM · · Score: 1

      Sony discovered with EYETOY on the PS2 that you need a controller for anything useful. Nintendo took that knowledge, but implemented it on a low budget system, and lost all the geeks - but gained the rest.

      --
      This is blinging
  5. Next Up On Slashdot! MS 'Invents' Open Source! by Anonymous Coward · · Score: 0

    Project Natal running on PlayStation 2 , 5 years ago

    http://www.youtube.com/watch?v=jYHr0I-iFHE

  6. stay the **** away... by martas · · Score: 4, Funny
  7. Re:MS Ripped Off Sony's Skill Points by NeutronCowboy · · Score: 2, Interesting

    That skill point is exactly like the point system in Leisure Suit Larry (the first one, since you're too young to know anything but PS2 games). Heck, you can even compare it to end-level score system in the first Sonic.

    What is it with Sony fanboys that they are the most neurotically defensive gamers around? They're beating even the gloating Nintendo fanboys of the 80s, the paranoid Sega fanboys of the 90s and the smug Amiga fanboys.

    Newsflash: everything's been done before. It doesn't matter if something's new, only if it works. In the meantime, stop foaming at the mouth. Sony will survive without you.

    --
    Those who can, do. Those who can't, sue.
  8. Re:MS Ripped Off Sony's Skill Points by Zerth · · Score: 0, Flamebait

    What is it with Sony fanboys that they are the most neurotically defensive gamers around? They're beating even the gloating Nintendo fanboys of the 80s, the paranoid Sega fanboys of the 90s and the smug Amiga fanboys.

    When you are spending 2-3 times as much for your console, you have to justify it to yourself. Obviously, if it cost that much, it must be at least that much better, otherwise you might have *horrors* been ripped off.

  9. Mod parent as GOD. by Anonymous Coward · · Score: 0

    Couldn't agree more!

    I'm getting a bit sick of the stupid bashing of companies for "copying", the entire damn business of ANYTHING has copied the competition in some form.
    Worse is when people do shit like this and try make the original (or anyone previous) inventor seem as if THEY copied.

    Natal couldn't be any more of a copycat of Eyetoy, they should just slap Xbox Eyetoy on the damn box.
    I'm not trolling, i'm just being truthful.
    But i'm not bashing the system at all. It is a nice system. The paint demo especially was pretty impressive.

    I don't know why Sony felt the need to go out to some company, the Eyetoy team are more than capable.

  10. Re:MS Ripped Off Sony's Skill Points by ZekoMal · · Score: 2, Informative

    And Nintendo had motion control with Kibry Tilt and Tumble on the Gameboy Color.

  11. Re:MS Ripped Off Sony's Skill Points by Deathlizard · · Score: 1

    They're call 'Skill Points' and they were first invented by Sony and Insomniac games all the way back in the late 1990s

    From what I've seen of these skill points, Their pretty much the same thing as getting the hidden world stars in Mario 64, only you get a star instead of an extra life.

    Sony had motion controls in games going all the way back to the early PS2 days

    And it sucked. Just about all of the Eye Toy games were "stand in front of the screen and flail your arms around like a crazy man" since all it responded to was movement. Natal can sense depth as well as position and movement, so it actually knows where you are in 3D space. Regardless, the real question is can Microsoft capatalize on it in such a way to make a game compelling enough to play. Even the Wii is struggling here.

  12. Not a good proof of concept for me today by Anonymous Coward · · Score: 0

    Smiling to catch the object? That makes the game way too difficult for me.

  13. I have a pretty funny story about Sony's system. by Anonymous Coward · · Score: 0

    Here's a picture I drew of two people having sex while they're both in the woman's panties. I thought the expression on her face was pretty funny. Questions? Comments? Suggestions? Please mod this up if you enjoyed my picture, or if you like the fact that I think Linux is better than Windows.

    http://img4.imageshack.us/img4/9705/unh1.jpg

  14. Re:I have a pretty funny story about Sony's system by Anonymous Coward · · Score: 0

    That's a pretty good likeness of you fucking your mom.

  15. eyeToy 2.0 by Anonymous Coward · · Score: 0

    Is detecting a smile that much more useful than what they already had with the eyeToy last generation?

  16. Spending how much again? by SuperKendall · · Score: 3, Insightful

    When you are spending 2-3 times as much for your console

    Compared to what? I play to own the PS3 for about ten years, playing online games as part of that. You buy the PS3 once and in the end the games are costing a lot more than the console, plus there are no recurring fees and you get a Blu-Ray player too.

    If you are comparing to a 360, you are a damn dirty hypocrite since you'll be paying more than me after just a year or two, and if you wanted to watch Blu-Ray discs ever are really running up a tab.

    If you own a Wii, carry on (except for the Blu-Ray point of course).

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  17. Amazing! by dangitman · · Score: 1

    Just think of all the hilarious motions going un-captured!

    --
    ... and then they built the supercollider.
  18. Natal ? by Anonymous Coward · · Score: 0

    Natal is part of South Africa, and is the homeland of the Zulu.

  19. Re:MS Ripped Off Sony's Skill Points by Datamonstar · · Score: 1

    How much does LIVE cost on xbox?

    --
    The eternal struggle of good vs. evil begins within one's self.
  20. Re:MS Ripped Off Sony's Skill Points by WhatAmIDoingHere · · Score: 1

    $0.00

    --
    Not a Twitter sockpuppet... but I wish I was.
  21. Re:MS Ripped Off Sony's Skill Points by Toonol · · Score: 1

    The 360 launched in two versions, "core" for $299 and "elite" for $399. The initial 20gb PS3 sold for $499, and the 60gb for $599.

    You perhaps could argue whether it was $100 or $200 more expensive, but it was clearly more.

  22. The Good Old Days... by Cabriel · · Score: 1, Insightful

    Maybe I'm looking through rose-tinted glasses, but I seem to remember this funny little thing that games used to be defined by. I can't remember the word for it... oh yeah. They were Fun. I can live without these new-fangled gimmicks. I don't see games being any more fun with the Natal system than with the Wiimote, nor do I see them being any more fun with Sony's system. The concepts are neat, but they just don't seem efficient. The focus is turning away from good games and more toward gimmicky games.

    I'll admit, the Wiimote is gimmicky, but Nintendo hasn't forgotten what Fun is.

    1. Re:The Good Old Days... by bogjobber · · Score: 2, Insightful

      You are being too nostalgic. Gimmicky games can be made for any control setup. There were crappy novelty games for the 8-bit generation and before as well.

      Advances in technology open up new ways to interact, which can create the opportunity for new types of games and advance current genres. I can't speak for the quality of this particular system, but new ways to interact with video games is a good thing. Your complaint isn't really relevant.

    2. Re:The Good Old Days... by Anonymous Coward · · Score: 0

      Oh, yeah, just think of all this is going to do for RPGs! I can't wait to jump up and down like an idiot to hit the enemy, or talk to my TV like a raving lunatic to finish off that quest. All that while only increasing development time by 3 to 4 years!

    3. Re:The Good Old Days... by TheRaven64 · · Score: 1

      You are being nostalgic. I have some very gimmicky games from the 8-bit era. I have a light-gun game for the C-64, for example, where every enemy comes through the same door and dies in one hit. Aim at that point and press fire repeatedly until you get bored with the game (about a minute for most people - oh, and it took ten minutes to load). Remember the little robot and all of the other gimmicky add-ons for the NES and Megadrive? Even the BBC micro had a few games with gimmicky controllers. By and large, these games weren't fun. It wasn't that they didn't exist, just that twenty years later you don't remember all of the dross, just the few games that were fun. For every game that provided hours of fun, there were hundreds that were utter crap. Take a look at the ROMs on some emulator site and remember that these are only the games someone went to the trouble of ripping and that there are others that are even worse...

      --
      I am TheRaven on Soylent News
    4. Re:The Good Old Days... by Ecsa0014 · · Score: 1

      I think the argument is very relavent. Yeah, gimmicky games have existed for every system but now everybody wants to design systems around gimmicky ideas. I remeber being totally immersed in many games without the need for fancy peripherals, I didn't need them because the games were fun. I had a Wii for a year before I sold it because the controls became very annoying and most of the games that were released were crap, Even the fun games were hampered by the controls. From what I 've seen of the Natal promos and videos, it just doesn't look very appealing. Yeah, the ideas seem pretty cool but I can see the controls growing old pretty quickly.

  23. That's a GOTY right there by ZuBsPaCe · · Score: 1

    Welcome to the future of gaming! Have fun with your friends while you stagger around like zombies! Please take a look at the feature video and behold the faces of the players! Yes! That's a smile right there! Sony brings joy to your life. Ain't that game great?

    And it's the only game you actually get better the more Jager's you kill.

  24. Except ... by OeLeWaPpErKe · · Score: 2, Informative

    The microsoft version is using Israeli military technology, it's not just a webcam. Or it is a webcam, but it's also something else.

    A small time before the camera sends another frame downstream a small led in front of the camera flashes. That flash has a specific color, that's rarely seen in nature. Then it resets one layer of the CMOS camera. Then, a short while later the frame is sent downstream ... with 4 color components.

    You have your superstandard red, green and blue channels. And you get a depth channel. The last channel indicates how long a time passed between the flashing of the led and that pixel seeing the color emanated by the led.

    In all but the most extreme situations (there are a few extreme angles that don't work as expected, a few materials that are not opaque to the sent-out color, and there's a minimum and maximum distance, which aren't stellar, as well as limitations on how many such camera's can be active at once, as they have to timeshare), that would be the distance between the eye of the camera and whatever object the pixel was on.

    Natal does not give you a 2d image, it gives you a 2.5d image (meaning x,y + height, not truly independent x,y,z coordinates), but still. The difference between normal pictures and natal pictures is like the difference between mario bros and duke nukem 3d.

    Natal is the combination of a camera + a (relatively short-range) 3d range scanner. That equipment doesn't really exist yet, and while camera's are cheap, I seriously doubt you can find a 2d range scanner running at 60 Hz for less than 50.000$.

    1. Re:Except ... by Anonymous Coward · · Score: 0

      Doesn't that sound exactly like the zcam in the link the GP gave?

  25. For Sony its too late by NeoStrider_BZK · · Score: 0

    Its research is already being called "Natal-Like".
    Hate MS or Like MS, they already got their mindshare with a really cool project.

    OTOH, If they dont research it and develop it, SCE will be regarded as a thing of the past.

  26. Re:MS Ripped Off Sony's Skill Points by Stevecrox · · Score: 1

    A PS3 costs the same as a Wii or an Xbox 360 these days. Below works on the following assumption Xbox and PS3 games tend to be single player with the multiplayer aspect online, while most of the Wii games tend to be Mulitplayer games where you need multiple controllers.

    In the UK a Wii will set you back £179 you will need anouther Wiimote £29.99 and atleast one nunchuck at £14.99. (I'm ignoring WiiFit and Motion Plus here). This means your looking at spending atleast £223.98. If you want two nun chucks and include Motion Plus (£19.99) then the price reaches £278.95. Thats £278.95 for a console Nintendo are already talking about replacing.

    For my Xbox 360 Comparison I'm assuming you only need a single controller since most of the games are single player with online play. An Xbox Elite will set you back £199.99 and if you want WiFi thats anouther £49.99. Meaning to enjoy the 360 your looking at spending £249.98.

    A PS3 Slim is £249.99 Making it £0.01 more expsive than the equivlent Xbox 360. It comes with Blu-ray as standard and Sony seem to suggest it will have a longer life cycle by several years.

    If you feel I've been unfair to the Wii in reguards to accessories wise a Xbox360 controller costs £29.99 and a PS3 controller costs £34.99.

    So yes the Wii is the cheapest at £278.95, the Xbox is inbetween at £279.97 and the PS3 is the most expensive at £284.98. The £10 price difference shouldn't be enough for anyone to care about and while the links I offered showed Games for the Wii and Xbox360 and not the PS3 in my expearence Game offers vary wildly for all the consoles and you can get a PS3 slim with COD5/GTAIV for the £249.99 price.

  27. This is not Natal-like by Anonymous Coward · · Score: 0

    Z-Cam signed an exclusive deal with Microsoft to make their time-of-flight camera a device for X-Box only. Natal is based on depth images.

    The thing shown in the video is face tracking in camera images (plus some classification algorithm to detect face expressions). Tracking is probably done using Gary Bradski's Camshift algorithm and you can read about how it works in his paper.

  28. Japan by Anonymous Coward · · Score: 0

    doesn't really invent anything, they're more of a jack of all trades, bringing technology together from other players.

  29. Re:MS Ripped Off Sony's Skill Points by Doggabone · · Score: 1

    How much does LIVE cost on xbox?

    $0.00

    This is misleading. These lists are pulled from the XBox Live site. XBox Silver, for free, gets you:

    • Free Game Demos
    • Movie Rentals*
    • TV Downloads*
    • Game Add-ons*
    • Downloadable Arcade Games*
    • Games on Demand
    • Avatars
    • Avatar Props
    • Voice, Text Chat

    XBox Live Gold, for $60 a year, adds:

    • Netflix (you still need to pay for Netflix, I think - no USA, I have no Netflix)
    • Video Chat
    • Online Multiplayer Gaming
    • Early Access to Content (some demos lauch for Gold members only, for a while)
    • Exclusive Discounts
    • Xbox LIVE Parties
    • Photo Sharing

    How much it costs depends on how much you want to do.