Microsoft Debuts Full-Body Controller-less Gaming At E3

quintin3265 writes "At today's Electronic Entertainment Expo press briefing, Microsoft unveiled Project Natal, a technology that eliminates the controller from gaming on the Xbox 360. In one demo, a player used her arms and legs to hit balls in an attempt to destroy a brick wall, and in another game, an employee threw virtual "paint" on a canvas to create a painting, even drawing an elephant using a silhouette feature. An accompanying video also demonstrated automatic login using facial recognition, videoconferencing with other Xbox Live members, and participating in a gameshow against another family through the Internet using speech recognition."

Comments

Activator

[Zero_DgZ]

Does anyone else remember the "Activator" controller for the Genesis/SNES? This sounds like an echo of that concept, but with updated technology that might actualy, you know... work.

Everything old is new again. Around and around we go...

Re:Activator

[bladx]

Ah ha ha... the "Activator"
The facial expressions of the guys in the video is almost equally as funny;

http://www.destructoid.com/sega-activator-the-crappiest-game-peripheral-26148.phtml

Re:Activator

[timeOday]

This sounds like an echo of that concept, but with updated technology that might actualy, you know... work.

The concept of "moving your body to make stuff happen" isn't novel, no. IMHO the value of the concept is beyond question, it's purely a matter of execution - i.e. whether it works. It would seemingly be extremely difficult to get the latency low enough. If the latency is low, even if the motion tracking is fairly crude, they should be able to use it to make a DDR "dance pad" (without the pad) that doesn't wear out and break. But heck, if it worked well enough, they could take all the electronics out of a normal gamepad and just watch your fingers instead. (I'm sure it doesn't have that level of acuity though).

Re:Activator

[Jurily]

Everything old is new again. Around and around we go...

No kidding. "Full-Body Controller-less Gaming" has already been invented. It's called "sport".

Re:Activator

[Sycraft-fu]

"Everything old is new again."

Well it isn't a surprise. A lot of these concepts are things people have wanted forever. The problem was that the technology to make them work well was prohibitively expensive if even available. The Powerglove is a good example. It was a piece of shit, but there were and are high end controllers like that which work well. It just would have been $2000 to make.

So it is no surprise that with more advanced technology, there is a resurgence. Now that the shit actually works, people want to try it.

Re:Activator

[duiu]

Everything old is new again. Around and around we go...

No kidding. "Full-Body Controller-less Gaming" has already been invented. It's called "sport".

Because I can get together with some friends and play a real game of Family Feud on the spot, without having to come up with categories and such first, just by going outside and getting a ball.

Re:Activator

[MooseMuffin]

From purely a tech perspective, it's pretty cool. The facial recognition to login and being able to control the dashboard by waving your hands was impressive. Ultimately though, much like the Wii, I don't think this will lead to many games that will interest me. Maybe even less so than the Wii, since the wiimote at least had buttons.

Re:Activator

[interkin3tic]

No kidding. "Full-Body Controller-less Gaming" has already been invented. It's called "sport".

Or, if you're into FPS, it's called "murderous office rampage."

Re:Activator

[ChromeAeonium]

Or, if you're into FPS, it's called "murderous office rampage."

Otherwise referred to as Monday.

Re:Activator

[SetupWeasel]

"Blue" ...
"Blue!" ...
"BLUE!" ...
"BLOOOOOOOOOOOOO!"

Voice recognition ain't that great. Better get practicing that Midwest accent. I have great doubts that you will get the in game Richard Karn to understand "Bar Harbor" as someone from Bar Harbor would actually say it. Of course that word would have to be in the system. It will be like a text adventure where only special words get recognized. Fun!

Re:Activator

[KDR_11k]

I really doubt it'll get used on FPSes, just doesn't look like it'd work for that. How would you even move? You can't just walk around, the game world is most likely larger than the area in front of your TV. All the tons of extra actions will also require pretty unnatural gestures to be recognizable (e.g. cycling through the weapons)

Re:Activator

[darthvader100]

Operation Office Freedom

too much work

[MooseTick]

This sounds good, but not the end all. The Wii controller can make things fun, but anyone who has used it much know how tiring it can be to have to stand or use full body motions for games for an extended period. Sometimes I just want to veg out on the couch and play a game. If I have to flail my arms all over the place I'm going to often consider it more work than fun.

Re:too much work

[Chabo]

Well, then when you feel lazy, feel free to look like a toolbox. ;)

Re:too much work

[TornCityVenz]

The idea you have to get up and move...and even get tired is actually a selling point, just look at the sells of the Eyetoy for play station...or even more to the point the Wii fit. There are a lot of gamers who could stand a bit more activity, and once you get past a certain point it's just embarrassing to go to a gym..at least some can get a bit of exercise in the privacy of their own home.

Re:too much work

[Chabo]

Back when DDR first came out, one of my friends from high school bought it, and started playing it for 30-60 minutes every day.

In about 4 months, he went from a 220-lb pudgy kid, to a 170-lb lean, muscular guy. It was hugely impressive!

Re:too much work

[CarpetShark]

Back when DDR first came out, one of my friends...went from a 220-lb pudgy kid, to a 170-lb lean, muscular guy. It was hugely impressive!

Yeah, trying to make music on a RAM chip can do that to you. You should be a pal and buy him an ocarina.

Re:too much work

[Trouvist]

And I'm entirely certain if you had asked him to dance at Prom or Homecoming he would have started hopping up and down moving his legs back and forth to the pace of the song...

Re:too much work

[sponga]

Back on my old Nintendo mat we used to run miles on that thing doing the track meets and other olympic stuff.

Forgot the name of that game, but you gotta hand it to Nintendo for the stuff they put out from the mat to the duck hunter gun to the bazooka in SNES to Wii.

Re:too much work

[FunkSoulBrother]

For a guy with a wife, you should be more cognizent of the fact that it is indeed desireable (on occasion) to rub one to Teens in Tight Jeans 2.

Re:too much work

[quintin3265]

DDR is great. I played it all the time and never understood why it became unpopular. What does Guitar Hero have that DDR did not? Especially the "cool" factor - people get amazed when you jump around and pass a song on DDR, but playing a guitar just looks.. boring.

Re:too much work

[Anonymous Coward]

yes i ran miles on that mat as well. and boy were my hands tired from hitting the ground so fast!

Re:too much work

[Jedi Alec]

Lifting weights with one hand + playing Freecell or Peggle on the other > Wii Fit.

Now, I don't know about you but I generally like the muscles in my body to be somewhat...balanced.

Going through life as a skinny guy with a huuuuuuge left biceps, wonder what the ladies will think about that ;-)

Re:too much work

[omibus]

Better link for you: http://www.penny-arcade.com/comic/2009/5/18/

Oblig. PA

[Anonymous Coward]

http://www.penny-arcade.com/comic/2009/5/18/

Full body power glove

[BigJClark]

The full body power glove. This one isn't doomed to failure. Not at all..

Re:Full body power glove

[Yvanhoe]

Not a power glove, still... I won't take anything "full body" from Microsoft. Ever.

Re:Full body power glove

[SetupWeasel]

The company that can't make a decent mouse thinks they can bust through all of the drawbacks of voice recognition, visual recognition, and gestures in a single bound?

This is going to be a lot like watching someone get kicked in the nuts: hilarious.

It's alright until..

[gilesjuk]

I'm sure it will work fine for some games, that is until someone walks behind you or moves around in the background to ruin your game.

Also, multiplayer will require a huge room and lots of sensors. But perhaps Microsoft expects people to play online, a console for people with no real friends.

Re:It's alright until..

[Leafheart]

But perhaps Microsoft expects people to play online, a console for people with no real friends.

That's one hell of a big market there. And always go for the biggest market.

I think the bigger announcement...

[Anonymous Coward]

...was that MS got Konami to make a 360 exclusive Metal Gear Solid franchise.

http://xbox360.ign.com/articles/988/988687p1.html

If /. is going to report anything about MS at E3 this was probably the biggest news at the conference.

Exercise?

[_Shorty-dammit]

If I wanted to exercise I wouldn't be playing video games.

Not impressed... yet.

[Chris Pimlott]

Hmm...

In one demo, a player used her arms and legs to hit balls in an attempt to destroy a brick wall, and in another game, an employee threw virtual "paint" on a canvas to create a painting, even drawing an elephant using a silhouette feature.

Sounds great, but I'd be much more impressed if they had a live demo with random untrained people. Even in the demo video, you can see a noticeable input lag, particular when the guy does his "victory dance" at around 27 seconds.

The devil is in the details with these things, Microsoft is certainly not the first to try at something like this.

Re:Not impressed... yet.

[citizenr]

Its not an input lag, the demo is staged. You can see it in couple of places where actors didnt replay exact moves from the screen. Whole "demo" is a wishful thinking.

Re:Not impressed... yet.

[KDR_11k]

Yeah, that video was just a mockup of what they think it might do some day (or pretend...), the live demonstration did have visible lag though.

What we need is....

[need4mospd]

What we really need is a gun that we could use to hunt ducks. I bet that would sell a lot more than this silly body controller....

Not A Real Metal Gear Game

[MediaStreams]

1. Kojima isn't directing the game

2. It's not a real Metal Gear game, just an action game with Raiden

3. It's multiplatform - PS3,PC, and Xbox 360

Even worse, just an hour after the Microsoft press conference an interview with Kojima quoted him essentially disowning the game.

 

Targeted at Wii Users

[BagOBones]

Other than figuring out how much you weigh this ONE accessory seems to be able to handle the functions of the WiiMote, Nunchuck, BalanceBoard and Motion Plus, without you having to purchase 4 of each and all the batteries to run them.
O and it ads a camera with mic / voice support. You can get a mic for the Wii now as well but I think animal crossing is the only game that supports it so far.

Re:Targeted at Wii Users

[Anonymous Coward]

Are you being serious here? The Wiimote and Motion Plus? Tell me how you could possibly ever play something like Metroid Prime: Corruption on something like this, in which subtle hand movements on the order of millimeters are measured real-time with pretty incredible accuracy from 3 meters away. I 100% guarantee that this device is not capable of coming anywhere even close to that. What are you going to do, shape your hand into a pointer and speak the buttons you want to press while controlling movement on a virtual joystick in your left hand? Give me a break dude, even in their staged, fake demo video the lag looks shockingly significant and is clearly nowhere near the accuracy of a Wiimote even without the Motion Plus. I feel like either you were smoking something when you watched that, or you've never actually played a game that made good use of the Wiimote. Either way, I think you should watch the video again; this is a full body Eye Toy, not a controller-replacing input revolution.

Re:Targeted at Wii Users

[iVasto]

I don't understand how the microhone operates. They show the device located directly in front of the tv, a spot where many people place their center speaker in a 5.1 set up. The game will have to completely mute the center channel in order for the microphone to work, thus making the game 2.1 (or 2.1 x2).

Be prepared for lawsuits

[CrazyJim1]

I did the math on this. Even if you make a full body suit capture or camera object recognition of the body it doesn't matter. Once you throw on the VR goggles, people may get into the game too much. People get hurt with the wii just moving their arms. Imagine the carnage of people jumping around with their eyes covered!

Re:Seriously guys

[Kuukai]

The EyeToy/PlayStation Eye has had some pretty amazing demos too, although I think you're right to point out that depth perception is new. This is basically two EyeToys, plus some decent software taking advantage of that fact. I think the Achilles' heel of this kind of technology is the install base, though. The launch will be neat, but more developers aren't going to sign on unless it's wildly popular. You could do an awful lot more with the PlayStation Eye, too, but interest always wanes after E3. I'm not against Natal (except for the name), I hope it succeeds, but history doesn't seem to be on its side...

Re:how?

[Pinky's Brain]

Well, the rumour was that they were going to use 3DV's cameras. Which essentially measure depth for each pixel, making it much easier to determine pose.

Re:Ultimate Jedi Knight Interface

[Locke2005]

Sure, it would be fun... but the controller would also cost over $500 and take up half your living room. I'm not sure there is a big home market for devices like that. For arcades, the insurance and maintenance would be problematic. Hmm... a power-jump inside a planetarium-style dome with 8 RGB projectors would make a really fun game, but again -- $$$.

Porn?

[freedom_india]

Forget carnage and hurt.
Iam thinking about Porn.
Imagine people playing Porn with Alba or Simpson in VR and in their excitement let their goo fly around!
Hallelujah!!!

!demo

[nog_lorp]

I don't know about you guys, but that looks strongly like a product of the marketing department, not a "set up the box and get a camera" style demo. Complete with cheesy clapping and cheering from the people on the couch.

Swordfighting.

[CannonballHead]

I've waited for years for a decent swordfighting game. That doesn't have to use a keyboard or controller that's obviously not suited for actually controlling the sword movements themselves. It would be awesome to be able to simply move your arm like you would a sword... or better yet, put a sword* in your hand and use that.

* Not sharp, of course. Think of the children.

Re:Swordfighting.

[Garrett Fox]

Now, with a better sensor system, you have another problem - it's still just a game, the players don't really know how to sword-fight.

I thought that increased realism was part of the point, though. I'd be interested in a swordfighting game that required learning something resembling a real-world skill, so that I'm prepared to... uh, battle skeleton warriors. More seriously, it seems like there's new gameplay to be found if I have to actually try different parries and attacks instead of just hitting Attack, or even High/Low Attack like in a Street Fighter game. If people don't really want anything resembling a realistic experience, why bother with a Wiimote-style controller at all instead of an old-fashioned controller? I guess the test of this reasoning is, would there be a market for a Guitar Hero imitator where the skills carry over somewhat to actual guitar, instead of being basically Simon with music?

Re:I hate this new trend in gaming

[PaganRitual]

I agree with the sentiment about wanting complex games and dislike this tech, but I think you're being a bit dramatic.

This sort of gaming is - from my big gaming nerd point of view - pretty gimmicky, but there is a market for it, and it will be pursued. And you've gotta appreciate that and roll with it.

What does concern me is when developers, whether it be because someone had a brain fade, or because the people in control of the money see that this sort of thing is 'popular', decide that motion technology needs to be shoehorned into games for which it completely doesn't suit. And to date there hasn't been a platform for which this hasn't happened. Ninja Gaiden Sigma on PS3, the 'hardest of the hardcore' game, requires you to shake the controller to increase the strength of your magic attacks. Uncharted makes you balance the controller to navigate narrow log paths. The DS has plenty of games that push touch screen or motion controls where it's not required. The developers of Nanostray decided that while you're trying to control a ship in a shoot-em up, it would be a great idea to make you have to use the touch screen to change weapons, instead of one of the four free buttons that have no use in the game. Not even as an alternative option.

Speaking of which, the Wii is the worst one for this sort of thing, and not just because there are games for which there is no option for a standard control set (Excite Truck, I'm looking at you), but because it's inexplicably attracts games which would have otherwise been deemed as more approching the 'hardcore' edge of the gaming spectrum. And yes, I'm specifically talking Tastunoko vs Capcom. And Monster Hunter Tri. How these games came to be released for the Wii over the PS3 I'll never understand. Maybe that's a slightly off-topic point, but it's frustrating, as a gamer, to watch these games go to a platform that won't allow them to reach their full potential, whether it be with tech, or with player base.

The 360, for all it's faults, is the last bastion of guaranteed normal, non gimmicky gaming. And the concern now is not your over-the-top assessment that this is the death of complex games, because it's obviously not going to be, but that this sort of thing is pushed out to a standard controller, and that developers will decide that it's a good idea to force in stupid motion sensitive crap into games that otherwise don't need it. If the motion sensitive tech could stay completely separate to the normal, 'proper' games, then everyone would be happy. As it stands the only people with a chance of being put offside are the ... damnit, is there another word that can be used to describe the ... 'hardcore' style of gamer, other than hardcore*? I hate having to use the word, and having to describe games as 'normal', or 'proper', but there seems to be no way around it.

(someone is frantically clicking reply trying to be the first to quote me and reply with, 'loser'?)

Will it be standard?

[SoftwareArtist]

There's a long history of innovative, unconventional game controllers. Most of them are nothing more than interesting historical footnotes. Few people bought them and few games used them.

What makes the Wiimote different is that it's the standard controller for the console. It comes bundled with every single console sold. That's why game developers actually use it: they aren't restricting their market.

If Microsoft decides to bundle this thing with every Xbox sold, then it's a big deal. If it's an optional accessory that you have to buy separately, then it's another historical footnote.

Re:Hi, Sony!

[Narishma]

The PS3 has a more advanced version of the EyeToy called the Playstation Eye and it can do a lot of these things. http://www.youtube.com/watch?v=KTarqm4FCDY