Microsoft Researchers Generate 3D Models From Ordinary Smartphones

New submitter subh_arya writes: Engineers from Microsoft Research have unveiled the first technology to perform 3D surface reconstruction from ordinary smartphone cameras. Their computational framework creates a connected 3D surface model by continuously registering RGB input to an incrementally built 3D model. Although the reconstruction results look promising, Microsoft does not plan to release an app anytime soon.

Comments

Windows 10

[0123456]

Fortunately, Windows 10 detects this attempt at copyright infringement, prevents the app from running, and sends your name and address to the cops.

Re:Windows 10

[U2xhc2hkb3QgU3Vja3M]

Cops? What cops? Look at the equipment used by cops today in the USA. They're local S.W.A.T. teams now.

this is old hat.

[nimbius]

I'm an engineer for Wayne Enterprises and I can assure you we've had this technology for 7 years available to purchase by military and defense agencies. Its only ever been used twice though, once for system testing and another time by Lucius Fox, one of our business section managers who said he was demoing it for a bat sanctuary or something.

Re:this is old hat.

[subh_arya]

Its true that the concept of 3D reconstruction from dense stereo/structure from motion is not new. However, the computational pipeline integrated entirely into a mobile device without any expensive hardware or offloading computation on a cloud, differentiates this effort from the previous ones.

Re:this is old hat.

[AmiMoJo]

I wish someone would make an app that I can measure objects with just the camera, and maybe a reference object fur scale.

Develop that and you too can live the life of Bruce Wayne.

launching it soon

[Anonymous Coward]

Seems the submitter didn't read the article:

Currently, the app is not available for download - however the team is planning on launching it soon.

123D Catch? Autodesk already has an app doing this

[gmezero]

Why is this news? I'm already doing this on my Android phone with 123D Catch and it's available for iOS and Windows Phone as well. You can find more about it here.

http://www.123dapp.com/catch

Re:123D Catch? Autodesk already has an app doing t

[bradgoodman]

Mod Up - was going to say the same. They look very, very similar.

Re:123D Catch? Autodesk already has an app doing t

[Thagg]

The differences are significant:

1) The Microsoft app works in real-time on the phone, rather than 123D Catch processing in the cloud
2) The Microsoft app shows real-time results, so you can see where there are issues, and continue to photograph until they are resolved. With 123D Catch you patch errors in post.
3) The Autodesk 123D Catch app actually exists, and the earlier web-based version has been around for about four years.

I'm kind of surprised that Microsoft isn't using the acceleration and magnetic sensors in the phone to help determine the camera position. It's one of the features that phone cameras have that DSLR's don't.

Re:123D Catch? Autodesk already has an app doing t

[subh_arya]

I'm kind of surprised that Microsoft isn't using the acceleration and magnetic sensors in the phone to help determine the camera position. It's one of the features that phone cameras have that DSLR's don't.

Actually they do. Fig.2 in the paper, where the IMU output is used to refine the camera pose estimated by purely image based means.