Exciting Kinect Stuff Already Coming Out
Just last week we learned that the Kinect had been hacked wide open and already we're seeing a flood of innovative stuff coming out. Jamie found a page with a lot of pictures and screenshots, and Engadget has more.
I can think of a lot of great uses for this technology.... I hope these hardware hackers keep it up
this is cool and what's going to happen is M$ is going to take the code and use it to add new features to Kinect in future releases. just like apple does with iphone jailbreak code and JB'd features
The amusing and quite cleverly done telescreen kinect as an advertising tool jokes I read here on slashdot were quite fun to see!
But.....I was very bemused to see this today, reported elsewhere:
"Microsoft's Dennis Durkin voiced an interesting idea at an investment summit last week -- the idea that the company's Kinect camera might pass data to advertisers about the way you look, play and speak. "We can cater what content gets presented to you based on who you are," he told investors, suggesting that the Kinect offered business opportunities that weren't possible "in a controller-based world."
And over time that will help us be more targeted about what content choices we present, what advertising we present, how we get better feedback. And data about how many people are in a room when an advertisement is shown, how many people are in a room when a game is being played, how are those people engaged with the game? How are they engaged with a sporting event? Are they standing up? Are they excited? Are they wearing Seahawks jerseys?
http://www.engadget.com/2010/11/15/microsoft-exec-caught-in-privacy-snafu-says-kinect-might-tailor/
yay?
This is what is called innovation. This is people doing different things with your Kinect device than you had ever dreamed of yourselves. Sorry you didn't think of it all yourselves.
"Microsoft's Dennis Durkin voiced an interesting idea at an investment summit last week -- the idea that the company's Kinect camera might pass data to advertisers about the way you look, play and speak. "We can cater what content gets presented to you based on who you are," he told investors,
Microsoft adds support for racial profiling!
but made available on other platforms (Linux, MacOSX, Windows).
A real hack would be to upgrade its firmware so it can prepare and serve you some coffee when you show it that your an coffee cup is empty...
So, you don't want me to stop you now?
Microsoft really missed the boat here. Instead of producing an amazing new piece of hardware and selling it like crazy, they produced the hardware, locked it to a platform, and then threatened to sue anyone who used it without a pre-existing agreement with them.
This could have really gone crazy if they'd just released a little driver and maybe an SDK and let PC developers go crazy with it. They could even have charged more for the 'PC version' of it, just like they did with the XBox 360 controller, even though the only different was the CD that came with it.
Not that they can't do that now, but they missed the hype period... And that's really helpful when pushing a product.
"If you make people think they're thinking, they'll love you; But if you really make them think, they'll hate you." - DM
I am sure it will be coming out, but the coolest thing to do would be to make immersible sports games where your body controls the motions of the player and you get a workout in return.
Baseball would probably be the easiest to start with.
He who knows best knows how little he knows. - Thomas Jefferson
So we have depth data, and webcam imagery of the same place. Where to go now? That's the problem - the field of image processing isn't actually that well developed that we can do things really useful with it. Sure, the hand-waving paint demonstration is cool but you could do that with a webcam ten years ago if you had the right algorithms. The Kinect only adds the depth-map through some (admittedly clever) physics but that just adds a third dimension that needs to be analysed, filtered, recognised and interpreted.
Yes, we can spot if someone has one hand or two in the air but we always could. We can follow a particular point of interest with some vague accuracy (watch where the bloke's hands go in that green-line-painting demo and what the software draws - they are often out by the whole width of a hand, and lag behind his actual movements) but we always could. We can colourise the images and make them look cool (black for near, pink for a bit away, green for a long way away) but again, that's always been available just with slightly different technology.
The problem we have is that hardware access and access to raw camera data is INCREDIBLY easy compared to actually doing anything useful with them. The green-line-drawing problem is no different to the 200-line VB app I saw in the 1990's that could do handwriting recognition from a shaky pen/mouse stroke - it works, mostly, if you don't need complete accuracy but it's still easily confused and why would you need to do that in the first place? The hard part is now actually interpreting that data and that relies on computer visualisation which is regarded in the same breath as "voice recognition" (which I have *never* got to work well enough for me and I don't have a particularly strong / incomprehensible accent). Yes, you can do a demo that you think looks useful but actually, apart from the odd toy project, there's not much substance underneath it all.
Yeah, you probably can write a quick Wii-Sports-a-like that's fun to play but you probably always could. And the difference is several dozen thousand lines of code to vaguely recognise a particular, fixed, object with limited parameters using what is essentially a webcam image with a little more data (involving processing several 640x480 and one 320x240 image in fractions of a second to obtain a particular data point), or just reading some single-axis acceleration data from a chip that spits it out (e.g. Wiimote) in a format you can use directly and provides roughly the same, if not better, accuracy when it comes to interpreting the correct movement.
The Kinect isn't anything special or revolutionary - sure, it's a nice toy and the depth-function is the best part, but that just adds a whole other dimension (actually a whole other 2D set of data because it obviously can do true 3D) to analyse and try to interpret - you coulda got that with a rapidly scanning laser or even just analysing two stereoscopic images properly. Certain filters and image-processing techniques can form edges, boundaries, object-approximations etc. from the resulting data but they always could and overall you still have to solve the vital problem - what to do with the existing data that you can't already do somehow? Follow hands for cool interactive-whiteboard-like presentations? I saw a multi-touch table at the Museum of London yesterday that did exactly that from a projected image and a single returned 2D webcam image. Follow some object to play pseudo-games? We've been doing that for decades but admittedly required things like reflective spots - Hollywood makes ENORMOUS such of such things, so they might be interested but chances are that this particular toy is way under-performing compared to something their technical guys could knock up in a real studio.
It's a good thing for independent toy-like games but look at the target market - someone who owns a Kinect and a PC (and presumably a 360, but not necessarily), knows it can be plugged into PC, has a knowledge of such independent projects and decide
I can't wait until a stable, generic driver comes out for it that sees gestures! I'll use it to control my tv in place of the wii-mote. :)
check out the Mp3 Garbler I built!
I'd like to point out the fact that they called the product "Kinect for Xbox 360" means its highly likely they are planning on releasing a "Kinect for Windows" at some point. Along with support for the kinect being used as a multitouch input driver for Windows (7/8). But its nice we are getting a head start.
Um, how about the fact that Microsoft came out with the Kinect in the first place? Isn't that pretty innovative? We wouldn't have a headline that reads "Exciting Kinect Stuff Already Coming Out" if not for a previous headline that read "Microsoft Releases Exciting New Input Device That They Spent R&D Money On For The Last Couple Years".
Sorry, but just because MS didn't fully develop and support everything someone in a dorm room can think of at the launch of their brand new hardware product doesn't mean they lack vision or innovation or whatever. Anything they release has to be supported in SDKs, APIs, be tested, etc., and that costs money and time. It's great that people are hacking it and coming up with new things to do with it, and I don't know why they tried to lock it down, but it's not locked down anymore, so who gives a crap?
For many who loath the idea of targeted ads I would assume many, if not most of those people are single. As a married old fart I can attest that A little intelligent ad targeting is nice. I for one get tired of feminine product advertisements because the wife uses my computer occasionally for shopping. Please, feel free to use the Kinect to determine if I am in fact: Male, Fat or Skinny, cheerful or pissed off. Because:
A: If I am male, I don't need tampon ads
B: If I am fat, don't advertise Big Macs, advertise weight loss because last I checked, fatties know where BK and McDs are. And no it's not your genetics, it's because you are irresponsible with your health. A predisposition just means you have to work harder. Thermodynamics proves this; your lack of responsibility, low self esteem, and discipline does not change the laws of physics.
C: If I am in a good mood try selling me a Beach Boy's collection. If I am pissed off Rammstien might be a better choice.
-=[ Who Is John Galt? ]=-
A lot of this stuff is using OpenCV, which is an awesome computer vision library.
Microsoft doesn't need your help to make it look bad.
How long it will be till TVs come with Kinects built in, and can't be turned off. It would be an advertiser's wetdream, and then the DHS could use it to monitor those who might be a "threat to national Security" (everyone).
_ _
Some of the images remind me of that Radiohead video ("House of Cards") which was shot entirely without optic cameras, just sensors.
That is why linux is not going to get into mainstream desktop as every thing you want to change you have to ..
edit some mysterious files...oh wait
Microsoft did not produce a new amazing piece hardare. THey licensed (or bought) it from PrimeSense and then, using the technology, they developped some software (body recognition, gestures, basic figure recognition, etc) and a corresponding SDK/API for a specific platform (Xbox 360 SO FAR).
Now, neither you or I know what were the terms for licensing PrimeSense technology. Nevertheless, there is *nothing* preventing them to develop drivers and an SDK for Windows /in the future/.
I know your compulsive "I want it noooow mommmy" mind cannot cope with maybe 1 year or 2 years of delay, but the fact is that Microsoft will most deffinitely provide this technology for PCs in the future mainly *depending on the reception of the platform*
Shit... it might even be the case that PrimeSense licenses the technology to other company (e.g. Playstation or Nintendo) so that hey can use it and make competing SDKs.
Just wait.
Virtual Reality is finally tangible on mainstream?
The flood of innovative stuff that's coming out could serve as prior art to upcoming patents surrounding this technology... Perhaps this will lower royalties and increase freedoms if we can figure out all the cool stuff first before it becomes patented.
Twinstiq, game news
what's going to happen is M$ is going to take the code and use it to add new features to Kinect in future releases
No they won't. Microsoft is notoriously unable to reuse free (as in libre) software that can't be repackaged into a binary that they can sell for $$$ without releasing the source code for. It's just impossible for them because of their very nature as a closed-source software vendor. Any GPL code out there will not be touched by Microsoft with a 10 foot pole.
So what if we write every possible iteration of code for Kinect and release it under GPL?
I can't be the only one who sees that this device could bring us Minority Report like interface interaction?
~Syberz
but Google is failing me as to its name.
I think you're talking about Face of the Future.
This video shows an interesting demo of someone teaching the computer how to recognize toys with Kinect as one of the sensors. The demo used all open sourced technologies that combines computer vision, speech recognition, and speech synthesis.
http://www.youtube.com/watch?v=fQ59dXOo63o
Microsoft announces firmware update for Kinect... (not quite true, yet.)
ELOI, ELOI, LAMA SABACHTHANI!?
Races = people with differently colored skin... in the infrared range?
Or can it tell I'm white because I'm wearing a bow-tie? :)
Selling to everyone is ALWAYS more profitable than locking it down.
Then why don't Nintendo and Sony sell devkits for their consoles to everyone? Instead of having a semi-open model like Xbox 360 Indie Games and iPhone App Store, where anyone can buy a complete devkit for the price of a computer, the target device, and $100/yr, these companies perform a vetting process requiring all developers to have a dedicated office and "game industry experience" (which I understand as a prior commercial title on another platform).
Microsoft has had a Power Toy available that controlled this feature since XP.
Get a Kinect paired with a 3D TV/Monitor to allow me to manipulate and visualize my network traffic in 3D? YOU SIR HAVE MY MONEY.
In general, Kinect may be just what it takes to turn the gimmicky 3D screens into a real tool. Coders! Start your IDEs!
I do security
As much as MS "does not approve" of this type of hacking, I tend to believe that the product sales won't be questioned just because they're not being used on an XBox.
I know how we can make this announcement look bad
I'll do you one better; I know how we can make this announcement look downright evil.
[...] Are they wearing Seahawks jerseys?
http://www.engadget.com/2010/11/15/microsoft-exec-caught-in-privacy-snafu-says-kinect-might-tailor/[...]
Are they under the age of 18 and playing half-naked in their room? Are they having sex while watching a movie when the parents aren't home? Microsoft engages in the monitoring of and sale of information abetting child pornography!