Slashdot Mirror
Stanford's New Website Converts Your Photos to 3D
An anonymous reader writes to tell us that Stanford has a new website that not only shows you how cool their new 3-d modeling system is, but actually allows you to give it a try with your own photos. The system can take a 2-d still image and estimate a detailed 3-d structure which you can navigate. "For each small homogeneous patch in the image, we use a Markov Random Field (MRF) to infer a set of "plane parameters" that capture both the 3-d location and 3-d orientation of the patch. The MRF, trained via supervised learning, models both image depth cues as well as the relationships between different parts of the image. Other than assuming that the environment is made up of a number of small planes, our model makes no explicit assumptions about the structure of the scene; this enables the algorithm to capture much more detailed 3-d structure than does prior art (such as Saxena et al., 2005, Delage et al., 2005, and Hoiem et el., 2005), and also give a much richer experience in the 3-d flythroughs created using image-based rendering, even for scenes with significant non-vertical structure."
Judging from how fast that website is melting, I seriously doubt this is realtime-capable. Also, just using binocular vision is *way* easier and more accurate. Compare two pictures taken from two known angles and you get a faster, more accurate picture.
About 20 years ago when they colorized Casablanca an office mate of mine was complaining about their ruining a perfectly good movie. I told him that he would be complaining even more when they used technology to make it in 3D. Seems that won't be too far away any more.
nt
Wow, can you imagine how cool this would be with respect to video games? Drop in some photos, crank up the customized first person shooter, and zoooom! You could even take photos or shots from movies and do the same thing (e.g., using Star Wars stills).
There can be NO END to the verys to describe how much of a very, very, VERY bad idea making a CounterStrike map of your school/mall/town/etc would be.
Radar and Lidar are good for some applications, but they're fundamentally quite different. They're both active sensing technologies- they send out energy in part of the electromagnetic spectrum and then look in that narrow range of the spectrum and see what bounces back. This means that you have trouble seeing things farther away since you'd have to throw more and more energy to keep your samples uniformly bright or uniformly spaced. And it means your power requirements are much higher.
I think the most interesting part of computer vision is that which deals with passive sensing, such as this work. It senses the electromagnetic radiation that comes from our sun, or moon, or man-made sources. By using the same spectrum that our eyes use it should be able to get a qualitative understanding of the world similar to what humans can achieve.
Also, as humans we've built the world to be visually interpreted at the EM frequencies that we sense. This means our signs are readable in those frequencies, our indoor lighting works in those frequencies, etc... By sensing in those frequencies you make sure you don't miss anything that humans can see.
Why do you think anyone cares?
I can think of a very good use for this: laparoscopic "keyhole" surgery. One of the difficult things about that sort of operation is depth perception: until you've tried to do it, it isn't at all obvious just how difficult it can be to get a 5mm scissor blade over e.g. a blood vessel at the right angle. If a computer could analyse the image and add some depth perception cues it could really speed up the surgery and make a difference when something's going wrong and needs to be sorted out fast.
Right, convert it into a set of sculpties in SL instead, and add prim parodies of neighbors that bug you.
Wow, can you imagine how cool this would be with respect to video games? Drop in some photos, crank up the customized first person shooter, and zoooom! You could even take photos or shots from movies and do the same thing (e.g., using Star Wars stills).
There can be NO END to the verys to describe how much of a very, very, VERY bad idea making a CounterStrike map of your school/mall/town/etc would be. The crazy old men from florida have won
You can't take the sky from me...
Maybe someone posting non-AC could quote it? Or is that too implausible?
how much of a very, very, VERY bad idea making a CounterStrike map of your school/mall/town/etc would be
Huh?!? Why would that be a bad idea? You're not one o' them mouth-breathers that think that video games CAUSE people to want to go shoot actual places up are you? It's actually a very very very GOOD idea to turn every real place you know of into a Doom/Quake/CounterStrike map and go blasting around in it because of how much you learn from working with 3D editors and taking pictures of the areas to try to get all your photoshopped textures right and so on. I know more than one person who honed their level design skills doing exactly that and went on to work at game studios.
Um...because one is a simple 3-d shape and the other cannot exist in a normal three-space, in the same sense that 'these two parallel lines meet' just won't happen. Hey, I can cut a spiral out of paper, so I must be able to make a square circle too, right? How would that follow?
(I expect the reply to this to be 'whoosh', but it looks serious to me.)