Computer Vision Tech Grabs Humans In Real-Time 3D

Tinkle writes "Toshiba's R&D Labs in Cambridge, UK have developed a system capable of real-time 3D modeling of the human face and body — using a simple set of three different colored lights. Simple it may be, but the results are impressive. Commercial applications for computer vision technology look set to be huge — according professor Roberto Cipolla. On the horizon: cheap and easy digitized everyday objects for ecommerce, plus gesture-based interfaces — a la Natal — and in-car safety systems. Ultimately even driver-less cars. 'This is going to be the decade of computer vision,' predicts Cipolla."

Comments

Skip to the chase

[Locke2005]

What implications does this development have for the pornography industry?

The obligatory response:

[internic]

There are four lights!

Re:The obligatory response:

[HTH NE1]

This is how the Martians see us.

Re:The obligatory response:

[HTH NE1]

This is how the Martians see us.

Overrated? You're making me feel old, and I wasn't even born yet.

It's a reference to the RGB eyes of the Martians in the 1953 movie version of The War of the Worlds. The tri-segmented eyes in the movie emitted red, green, and blue light, illuminating the subject, allowing the cyclopian Martians to see in 3D, just like how a cyclopian camera can derive 3D information using this method now. Otherwise, as depicted with Futurama's Leela, a cyclops would have no depth perception.

Of course, the amount of depth perception would depend on the spread of the lights, so even the Martians' sense of depth would be limited, but not non-existent.

Obvious applications in rapid prototyping.

[Anonymous Coward]

Right now, 3D camera technology to scan a hand-made prototype into commercial CAD software revolves around a scanning laser, and special cameras, and a turn table.

Combining this technology with other image mapping software would allow you to use 3 or 4 fixed cameras with overlapping FOVs, you would be able to simply set your source model on a table, turn on the lights, take a picture, and you are done.

I would SOO love to have a FOSS implementation of this modeling software.

(I sculpt, and being able to make a large physical object, scan it, then send the digital model to a rapid prototype house and get a miniature size made from the digital version would be VERY handy.)

Re:Obvious applications in rapid prototyping.

[ircmaxell]

What I would find interesting, is if they could make RGB lights that flash each color for only a tiny fraction of a second. So to the average person, the light looks white, but to the camera (which would need to be fast to read that much change) it appears the color for that frame. So that way, you could have a system like this in a normal room, and record a 3D model of the room at all times (Think of a security camera, but one that could take a 3d image instead of a 2D one)... It seems cool so far, let's see if it matures...

Re:Obvious applications in rapid prototyping.

[amRadioHed]

Or even better would be a system that uses infrared or some other wavelength that we can't see.

Re:Obvious applications in rapid prototyping.

[HTH NE1]

The whole point of this, would be so that the lights could appear white to the human eye (And hence can double for normal lighting in a well designed room), while still providing the segmented colors necessary for this technique to work.

The positions you need to put the colored lights in for the math to work properly are not the same positions one uses to properly light a subject being recorded. You'll produce an environment where the subject is overly lit and you'll have to resort to virtual lighting to properly illuminate the 3D model in post. And if you're going to have to do it in post, why bother with the expensive strobing and high-speed videography?

This will be used in a controlled mocap-like environment, but without the ping-pong balls and spandex. That alone is enough of a technical advancement that your talent won't mind the colored lights. They won't even need to apply makeup. Hairstyling though looks to still be an issue. You may need skullcaps and CG hair for awhile yet.

Re:oic

[amRadioHed]

I would feel much safer. Drivers are the cause of most crashes. If they can be replaced with something more reliable it would be a huge improvement.

Colors

[Conspiracy_Of_Doves]

Instead of red green and blue, could they use three different frequencies in the infrared range? Then they could also take photographs in normal visible light and wrap then around the model.

Re:Colors

[HTH NE1]

You'd need a custom CCD that's sensitive to each of those frequencies, as well as method of storing the image preserving the intensities of each component. And if you want a color full-motion 3D model, that CCD would need to be sensitive to six frequencies--the 3D sampling set and RGB--all at once. To fit all those different sensors will enlarge your CCD, else you'll lose resolution.

Re:Implications

[oldspewey]

If the letter is in fact addressed "Dead Keith Jr.," then shouldn't it say something more along the lines of "in the last three months we have noticed that you have turned ghoulish grey and started to stink like hell. Please stay the fuck in the ground and stop disturbing your former friends and neighbours."

Interference

[acheron12]

Since this requires shining lights on the object to be digitized from particular angles, two or more independent vision systems (e.g. in driverless cars) would probably interfere with each other.

Re:oic

[WrongSizeGlass]

I would feel much safer. Drivers are the cause of most crashes. If they can be replaced with something more reliable it would be a huge improvement.

Let's ask Toyota owners how they feel about 'driverless cars'. All it takes is one small problem, or even an incompatible system amongst the many manufacturers (keep in mind that odds are they all won't be running Linux).

This reminds me of Itchy & Scratchy Land and its inspiration, Westworld. What could possiblye go wrong?

John Bell, err, Bill Joy was right!!!

[Anonymous Coward]

Just improve skynet's target acquisition algorithms, why don't you?!!!

All your face are belong to us

[moteyalpha]

That is a fantastic leap in thinking!
I am wondering if this technique could be used with the spectrum of stars to identify the 3 dimensional structure of distant galaxies and clouds of gas?

Re:Implications

[WrongSizeGlass]

I hate to be a downer, as I'm often fascinated by computer vision technology, but aren't there some very negative potential applications here?

You mean like how this will affect a bunch of epileptic kids walking down the street on a school field trip?

I wonder

[spleen_blender]

if it will be able to perceive black people.

http://www.youtube.com/watch?v=t4DT3tQqgRM

Re:Implications

[Tekfactory]

"Dead Keith Jr.,

in the last three months we have noticed that you have gained 15% in body mass. Please report to the gym immediately or your health care benefits will be suspended."

From the Greeting I'd think his health benefit was already suspended.

I guess that bodies really DO bloat a little after death.

Real Avatars and computer gaming

[NonSenseAgency]

One of the uses mentioned in the article was that this would enable gamers to upload realistic portrayals of themselves into computer games as their avatar. Unfortunately ( or perhaps fortunately for some of us), real virtual life isn't anything like Neal Stephenson's "Snowcrash" novel. Most gamers, unlike the hero Hiro Protagonist (pun intended) do not want to look like themselves at all. They are bigger, or meaner, or better looking or in the case of all too many, not even the same gender. What would seem far more likely is a market springing up in avatars made from recordings of real people. So this begs a whole new question, who owns your avatar? Intellectual Property rights just took a huge twist.

Don't drivers cause all crashes

[jweller13]

I would venture to say that drivers cause 100% of car driving accidents.