Slashdot Mirror


Google Earth Beaten By Autorendering From Photos

Flu writes "Sweden's major engineer newspaper NyTeknik writes about a new technology which is used to automatically convert 60.000 aerial photographs of Stockholm, Sweden, into a 3d-world, similar to Google Earth's rendering of major buildings in some US cities. But unlike Google's laser-measured rendering, this technique took less than 8 days (including the photography) to automatically generate the 3D-model of Stockholm — which includes every building and details as high as individual trees! The program was developed by C3, a subsidiary of the Swedish defense industry company SAAB, together with a PC gaming company called Agency 9. The complete article is available (sorry, Swedish only), but the 3D-rendering of Stockholm is available as a Java applet from the Swedish phone-dictionary service Hitta.se (tick the checkbox — it's an ordinary disclaimer, and click 'Till 3D-kartan')." The technique used gives a cool water-color look to the scenes, too.

40 of 176 comments (clear)

  1. first post by alxtoth · · Score: 5, Funny

    does playing with the maps count as RTFA ?

    --
    http://revj.sourceforge.net
    1. Re:first post by houstonbofh · · Score: 4, Funny

      I had a little trouble. It was nothing like the Swedish I learned on the Muppets.

    2. Re:first post by f8l_0e · · Score: 3, Funny

      You should feel right at home here, then.

  2. Game mods by Enderandrew · · Score: 4, Interesting

    How long until someone uses technology like this to do a GTA-like in actual New York City, with real buildings as opposed to Liberty City? Admittedly, that would start getting creepy when you realize those are real residences and the like.

    --
    http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
    1. Re:Game mods by OeLeWaPpErKe · · Score: 5, Funny

      Then we can plan out bank robberies and gauge the different police reactions in a virtual game before one proceeds to ...

      Oh wait. Someone's at the door. Guantanamo ? But I don't want to go to ...

    2. Re:Game mods by urcreepyneighbor · · Score: 4, Informative

      Admittedly, that would start getting creepy when you realize those are real residences and the like. Yeah, nothing like that has ever happened before.
      --
      "The fight for freedom has only just begun." - Geert Wilders
    3. Re:Game mods by Quarters · · Score: 4, Insightful
      Probably never. Even if the resolution was adequate (which it isn't) and you could somehow extrapolate street level views from aerial photography (you can't) there are still the issues of photo retouching and missing information for stacked spaces. Unless the plane could somehow magically photography the entire city at predetermined times of day and days of the year so that all of the images were lit identically and cast shadows in the same direction/length there would be an astronomical amount of work needed to retouch the source data for continuity. On top of lighting and shadows you'd have to remove all representations of people and cars, etc.. from the source data. Assuming you could get all of that done there's still the problem of missing data from stacked surfaces; tunnels, elevated trains, subways, overpasses, building interiors, etc... None of those spaces can be represented via extrapolated aerial photographs.

      With the amount of dataset rework / additional work that would be necessary to create an artistically pleasing & competitive game with such data it will be a long long time before you see it even coming close to being more cost effective than hand creating a world to fit a game's specific needs.

    4. Re:Game mods by maxume · · Score: 4, Interesting

      I would think that they could extend the technique to process 4 or 5 sets of data in order to eliminate things like shadows and fast moving objects (so cars, people, construction, etc). Probably not cost effective, but I don't think you would need to worry about capturing identical shadows, I think you could make sure that you captured different shadows and then process them out.

      --
      Nerd rage is the funniest rage.
    5. Re:Game mods by i.of.the.storm · · Score: 2, Interesting

      Funny, one of my friends did that with our school I think, but I'm not exactly sure what happened with it. We're in California though, so that story isn't about us.

      --
      All your base are belong to Wii.
    6. Re:Game mods by NickCatal · · Score: 3, Interesting

      Exactly

      But also remember, there is a LOT of continuity in cities. Especially on commercial buildings.

      The best one I could think of are those huge industrial chillers that commercial institutions have on their roofs for their AC. There aren't a billion models of them, so if you could somehow detect the model of the AC units in one photo you already have a good amount of geometry going for you.

      Then you figure out what cars are on the street. A Prius has a specific shape that really doesn't change from Prius to Prius, so you know some of the details about every car on the street.

      Manholes are a standard size, if you were to figure out what type of manholes you had in your picture you have more data. How many police boxes and fire hydrants are there in a photo of a NYC block?

      If you gave me a super-high-resolution photo of a city block I could find literally hundreds if not thousands of points of reference. Soda bottles and cans... the list goes on

      --
      -nick
    7. Re:Game mods by philspear · · Score: 3, Funny

      You are a gamer and therefore have nothing BUT evil intentions.

    8. Re:Game mods by Deanalator · · Score: 2, Funny

      You know, when that school gets taken over by Russian terrorists, those administrators are going to be very sorry that they deprived the students of the proper training material to take the school back.

    9. Re:Game mods by Anonymous Coward · · Score: 3, Insightful

      You're right if you assume that one wants a perfect representation directly derived just from the aerial photos, but that's not necessarily the case. From the aerial photos you can reconstruct an approximate 3D model of the facade of the buildings (by making assumptions about where shadows are or by combining multiple photos from different perspective) and derive a unifromly lit texture for the building. It's not all that difficult with buildings since those tend to be symmetrical and have lots of repeating structures, i.e. the windows tend to be of equal size and shape. The street-level details may be mostly visible if you have multiple photos and wide streets with buildings of limited height. For a game it would probably be enough to construct all the missing details algorithmically, and only add the "real" details from ground level photos or hand-built 3d models where famous sights are found or where the game plot requires it. I'd say such "close enough" game levels will be available within 3-5 years.

  3. Java applet served by an ASPX page by slarrg · · Score: 4, Funny

    There is no stranger marriage.

    1. Re:Java applet served by an ASPX page by larry+bagina · · Score: 4, Funny

      They could be using J# on the server.

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

  4. OMG by indy_Muad'Dib · · Score: 5, Funny

    all the buildings in Stockholm are partially melted, this must prove global warming!!!

  5. Microsoft was so close... by Anonymous Coward · · Score: 5, Interesting

    This kind of model is what you get when you take the point cloud from Photosynth, mesh it and use the photos as textures.

  6. viewing angle by nguy · · Score: 4, Informative

    The techniques for recovering 3D shape from photographs have been well known for a while. But if all the pictures you use for the 3D reconstruction are from overhead, the street level view will be missing all the stuff you can't see from overhead. It may be called a "3D model", but it's not a complete or accurate 3D model.

    If you want decent street level views, you really do need street level photographs. And laser scanners are still a lot more reliable than image based 3D reconstruction.

    1. Re:viewing angle by BiggerIsBetter · · Score: 2, Informative

      It's still very cool considering the small time and cost involved. Even if not mm-perfect, it's still invaluable for travellers making plans and virtual tourists alike.

      --
      Forget thrust, drag, lift and weight. Airplanes fly because of money.
    2. Re:viewing angle by Rei · · Score: 3, Interesting

      How long do you think it'll be before there are street level views of, say, Devil's Canyon, the middle of the Namib desert, or halfway up K2? The beauty of this is that it lets you get a map of virtually anywhere from the air. No, it's not perfect. It looks kind of like a cross between a Salvador Dali painting and Magic Carpet; around every corner I expect to see either a melting clock or a balloon picking up mana spheres ;). But the fact is that it was able to be assembled with minimal computational effort from a resource (aerial photos) that is already widely available for many areas -- and, for areas where it's not, can be rapidly gathered. Sounds like a winner to me.

      --
      For the love of Crom, am I the only one here who wants to keep the U.S. technologically competitive?
    3. Re:viewing angle by nguy · · Score: 3, Informative

      The beauty of this is that it lets you get a map of virtually anywhere from the air.

      No, that isn't the beauty of "this". These people have done a poor job at 3D rendering from aerial imaging. If you want to see well-rendered photographs based on aerial imaging, have a look at the Mars Express pictures:

      http://www.esa.int/SPECIALS/Mars_Express/SEM565R03EF_0.html

      That was done 10 years ago, and even then, the underlying technologies weren't new.

  7. Sure this is Stockholm? by Chaxid · · Score: 5, Funny

    The 3D map looks more like post-apocalyptic Stockholm.

  8. Re:I guess.... by Colz+Grigor · · Score: 3, Insightful
    No one from VA needs to confirm that 100% of /.'s audience is international. It's a known fact!

    Now, were you trying to suggest that a majority of /.'s audience resides outside of the U.S.? That's a bit different...

    ::Colz Grigor

  9. Translation with help from Google. by MaXMC · · Score: 5, Informative

    I'm posting the article in English here with some changes due to Translate.Google not being able to translate everything 100%.

    ---
    Hitta.se beats Google Earth
    with new 3D-technology from Saab.

    Search company Hitta.se has a new Web service that is better than Google Earth to show Sweden in a 3D view. In Stockholm there, for example, every single building as a realistic 3D model.

    With the help of robotics from Saab and the Swedish software for computer games Hitta.se search company has developed a Web service that shows Sweden in 3D and which is clearly better than the corresponding service from Google Earth.

    Directly in the browser, users can zoom in, tilt and turn the flygfotograferade views across the country. With the help of altitude measurements images of the land are created where the mountains and valleys appear with genuine feeling of depth.

    The new service, which launched May 29, is also all buildings from Stockholm, in the form of realistic 3D models.

    Although they can be turned and turned and seen from any height and angle.

    Later this year, including the second appearance of Sweden's largest cities as a complete 3-D models.

    The major competitor in the show Sweden in 3D is Google Earth. But there are only a few dozen 3-D buildings from Stockholm and a few other cities.

    Google's 3D view of Sweden was also much lower quality than that Hitta.se offer. Both in terms of image resolution and altitude.

    -- We have created 3-D feature to give users a more fun and more realistic ways to use our maps, "says Rui de Sousa Brit who is president and CEO of Hitta.se

    But the new service does not yet cover all planned features. Therefore, it's "sneak launched" and goes by the name of "the lab" on the company's website.

    Moreover, such as some 3D buildings refined when the houses angles can be a little crooked and some facades have bad sharpness.

    The technology used was developed by the Swedish companies C3 Technologies in LinkÃping and Agency9 in Lulea.
    C3 is a subsidiary of Saab and develop technology that has its origin in seeker for robots.

    The technology is based on high resolution aerial photography with carefully calibrated cameras. In order to build 3-D model of Stockholm, which covers an area of 200 square kilometres was 60 000 images from 600 metres above sea level, which took three days.

    Then, it took only a few more days to automatically create 3-D model, where even individual trees are included.

    Tommy Johansson who is president and CEO of C3 know that some defence in the world have developed similar technology. But he is not aware of anyone else who introduced the technology for civilian purposes.

    -- We aim to launch our technology globally and believe that, for example, urban planners and businesses similar Hitta.se can become our customers, "says Tommy Johansson.

    Other companies based 3-D models of entire cities primarily use lasermÃtningar to collect 3D data. For example, Google and Microsoft for their service Virtual Earth.

    It is a technology that is much more costly and time consuming than the C3's way.

    Photo and mapping services from Google and Microsoft require users to install special software on your own computer. In Google Earth in the form of a stand-alone program and the Virtual Earth as a plug which is available only for Windows.

    But Hitta.se 3D runs directly into the browser by using javateknik and works for most operating systems and browsers.

    -- I think that both Google and Microsoft may have some problems with sleep when they see the new service from hitta.se, "says Tommy Johansson.

    In order to be able to present all 3D data in the new map in the form of realistic buildings used technology developed for computer games.

    It comes from the Agency 9 of Lulea.
    The company began by building a so-called rendering engine for web games. Eg. software that draws up 3D environments on the computer screen.

    -- But the web

    1. Re:Translation with help from Google. by Rei · · Score: 5, Funny

      And, for our Swedish readers, I'll translate it back for you.

      ---------

      Heetta.se-a beets Guugle-a Iert
      veet noo 3D-technulugy frum Seeb. Bork Bork Bork!

      Seerch cumpuny Heetta.se-a hes a noo Veb serfeece-a thet is better thun Guugle-a Iert tu shoo Svedee in a 3D feeoo. In Stuckhulm zeere-a, fur ixemple-a, ifery seengle-a booeelding es a reeleestic 3D mudel. Bork Bork Bork!

      Veet zee help ooff rubuteecs frum Seeb und zee Svedeesh sufftvere-a fur cumpooter gemes Heetta.se-a seerch cumpuny hes defeluped a Veb serfeece-a thet shoos Svedee in 3D und vheech is cleerly better thun zee currespundeeng serfeece-a frum Guugle-a Iert.

      Durectly in zee brooser, users cun zuum in, teelt und toorn zee flygffutugrefferede-a feeoos ecruss zee cuoontry. Veet zee help ooff elteetoode-a meesoorements imeges ooff zee lund ere-a creeted vhere-a zee muoonteeens und felleys eppeer veet genooeene-a feeleeng ooff dept.

      Zee noo serfeece-a, vheech loonched Mey 29, is elsu ell booeeldings frum Stuckhulm, in zee furm ooff reeleestic 3D mudels. Bork Bork Bork!

      Elthuoogh zeey cun be-a toorned und toorned und seee frum uny heeeght und ungle-a.

      Leter thees yeer, incloodeeng zee secund eppeerunce-a ooff Sveden's lergest ceeties es a cumplete-a 3-D mudels.

      Zee mejur cumpeteetur in zee shoo Svedee in 3D is Guugle-a Iert. Boot zeere-a ere-a oonly a foo duzee 3-D booeeldings frum Stuckhulm und a foo oozeer ceeties.

      Guugle's 3D feeoo ooff Svedee ves elsu mooch looer qooeleety thun thet Heetta.se-a ooffffer. But in terms ooff imege-a resulooshun und elteetoode-a. Bork Bork Bork!

      -- Ve-a hefe-a creeted 3-D feetoore-a tu geefe-a users a mure-a foon und mure-a reeleestic veys tu use-a oooor meps, "seys Rooee de-a Suoosa Breet vhu is preseedent und CEO ooff Heetta.se-a

      Boot zee noo serfeece-a dues nut yet cufer ell plunned feetoores. Zeereffure-a, it's "sneek loonched" und gues by zee neme-a ooff "zee leb" oon zee cumpuny's vebseete-a.

      Mureufer, sooch es sume-a 3D booeeldings reffeened vhee zee huooses ungles cun be-a a leettle-a cruuked und sume-a fecedes hefe-a bed sherpness.

      Zee technulugy used ves defeluped by zee Svedeesh cumpuneees C3 Technulugeees in LeenkÃpeeng und Egency9 in Loolea.

      C3 is a soobseediery ooff Seeb und defelup technulugy thet hes its ooreegin in seeker fur rubuts.

      Zee technulugy is besed oon heegh resulooshun eereeel phutugrephy veet cereffoolly celeebreted cemeres. In oorder tu booeeld 3-D mudel ooff Stuckhulm, vheech cufers un erea ooff 200 sqooere-a keelumetres ves 60 000 imeges frum 600 metres ebufe-a sea lefel, vheech tuuk three-a deys.

      Zeen, it tuuk oonly a foo mure-a deys tu ootumeteecelly creete-a 3-D mudel, vhere-a ifee indeefidooel trees ere-a inclooded.

      Tummy Juhunssun vhu is preseedent und CEO ooff C3 knoo thet sume-a deffence-a in zee vurld hefe-a defeluped seemiler technulugy. Boot he-a is nut evere-a ooff unyune-a ilse-a vhu intrudooced zee technulugy fur ceefiliun poorpuses.

      -- Ve-a eeem tu loonch oooor technulugy glubelly und beleeefe-a thet, fur ixemple-a, urbun plunners und booseenesses seemiler Heetta.se-a cun becume-a oooor coostumers, "seys Tummy Juhunssun.

      Oozeer cumpuneees besed 3-D mudels ooff inture-a ceeties preemerily use-a lesermÃtneenger tu cullect 3D deta. Fur ixemple-a, Guugle-a und Meecrusufft fur zeeur serfeece-a Furtooel Iert.

      It is a technulugy thet is mooch mure-a custly und teeme-a cunsoomeeng thun zee C3's vey.

      Phutu und meppeeng serfeeces frum Guugle-a und Meecrusufft reqooure-a users tu instell speceeel sufftvere-a oon yuoor oovn cumpooter. In Guugle-a Iert in zee furm ooff a stund-elune-a prugrem und zee Furtooel Iert es a ploog vheech is efeeeleble-a oonly fur Veendoos.

      Boot Heetta.se-a 3D roons durectly intu zee brooser by useeng jefetekneek und vurks fur must oopereteeng systems und broosers.

      -- I theenk thet but Guugle-a und Meecrusufft mey hefe-a sume-a prublems veet sleep vhee zeey see-a zee noo serfeece-a frum heetta.

      --
      For the love of Crom, am I the only one here who wants to keep the U.S. technologically competitive?
  10. Re:Nifty. by zappepcs · · Score: 2, Interesting

    I can't remember where now, but I remember some military contractor type company working to clear up image meshing like this on a robotic vehicle program somewhere (at least I think I do, but now can find no links for it). If they clean up the details with revised software, this would be an awesome terr^H^H^H^H^Hflight training sim setup.

    The story I read was about creating 3D maps from sat pictures, inserting geodata where it was known, and using this as guidance data for unmanned passenger vehicles like the latest DARPA challenge.

    Theoretically, if you can update photos every other day, you could use this to map alternate routes for drivers, and correct inconsistencies in map data for Google maps and Yahoo maps et al.

    It's all about the speed of updates. I'd think a single helicopter flying with a rather fancy camera setup (something like they use for capturing a murder scene etc.) could cover a metropolitan area in a day, crunch the photo data, update... presto, accurate maps. Even 8 days is pretty damn fast.

  11. At least google earth works by Prikolist · · Score: 2, Insightful

    Dunno what's the big deal about, I can't even get the thing to work, it just takes up both CPU's and doesn't show anything... On the other hand I can start up Google Earth and it will work in seconds. But that may be some software bug on my side, whatever.

    Anyway, I'm sure this may be cool for people in Stockholm, but unless they plan to expand this to worldwide scale, this will just remain another web's curiosity for the bored and an occasional /.-reading tourist. And, mind you, catching up to Google's amount of maps and images and databases would not be an easy thing to do.

    --
    I think Linux isn't better than Windows hence in the slashdot realm I'm a troll
  12. Scary ... by brunokummel · · Score: 3, Funny

    it's kind of scary when you zoom out the whole map and see a "flat world with only Sweeden in the middle.." ... =)
    There may be dragons...

    --
    What is best in life? To crush your enemies, to see them driven before you and to hear the lamentations of their women.
  13. Re:This just in... by KokorHekkus · · Score: 2, Informative

    Yeah, I doubt that Google would want to acquire a major defense contractor (the automotive part was sold to GM and the rest remained in Sweden for most parts). The SAAB AT4 has even been adopteb by the US Army where it's know as the M136 antitank grenade launcher (http://en.wikipedia.org/wiki/M136)

  14. slashdotting by jonastullus · · Score: 4, Interesting

    It seems as if the geometries are calculated from scratch in real time.

    This article is gonna have quite an effect on their servers ;)

    At first I though: *yuch* this is awful with the geometries being at very low resolution and with strong artifacts. But as the script kept processing it's looking really good by now, except that it's still hour-glassing and I can't zoom in after minutes.

    1. Re:slashdotting by Raistlin77 · · Score: 4, Funny

      I was able to zoom in fine, but once I zoomed in as far as it would let me, I was quickly reminded of some good shrooms from back in the day...

  15. Google Earth Beaten? by MrMista_B · · Score: 2, Insightful

    Beaten how, exactly? This is just one city. Google Earth covers a heck of a lot more than once city. Sure, the rendering is fine, but again, compared to Google Earth as a whole... eh, not what I'd call "beating Google Earth" by any stretch.

  16. mnb Re:Illegal in the States? by Anonymous Coward · · Score: 3, Insightful

    Considering most of the high-res aerial mapping is done on a county-by-county basis (rarely even state-wide) the large number of governmental agencies Google would need to contract with to provide sub-foot imaging is immense. The most common user of high-res aerial mapping is county GIS departments, and very few of them ask for the overlapping stereo images needed to model heights. (Or you could do it with lidar, but again most county auditors have little use for the height data.)
    The COE is still so far back in the stone-ages they want traditional sections run, and are not large users of aerial mapping. (Not as large as they should be.)

    That said, the volume of high-res photos out there is huge. We just finished up a state-wide lidar job of XXXXX, with elevations provided (post vegetation and building removal) tight enough to provide 6" contours. The accompanying images are 3" resolution. Where can you get the images? I have no idea.
    We do similar work for the FAA. (Only practical way to do obstruction surveys is with photogramitry.) Do they release those 1/4' images? I do not know.

    There is no reason to believe Google shows poor-quality images for any reason outside an unwillingness to pay for the acquisition.
    Have you seen the high-res obliques Microsoft provides now? Those clearly aren't banned in the name of security.

    Ask your local Auditor for a copy of their aerial mapping data - often it is free or for a nominal fee. (varies county by county and state by state in my experience, everything from 10 DVDs for free to $100 per CD)

  17. A disaster! by Anonymous Coward · · Score: 5, Funny

    OMG - Stockholm has been hit by an earthqua... oh wait... there it goes...

    this is great! Let me zoom in...

    OMG - Stockholm has been hit by an earthquake!

  18. Re:Wake me when....... by furbearntrout · · Score: 2, Funny

    Coulda been a cold day. Man, Stockholm is beautiful. I would like to visit. ahh, nippies.
    --
    Crap. What did the new CSS do with the "Post anonymously" option??
  19. Re:google hate by Koiu+Lpoi · · Score: 3, Insightful

    Not quite. They're commenting on the fact that Google (a company that is known for excellence) has had one of their offerings beaten by using a simpler technique. This isn't a "google hatefest", it's just cool.

  20. Re:This just in... by icegreentea · · Score: 3, Interesting

    Not to mention the Gripen. Damn fine fighter plane. It's maybe a generation or half behind the bleeding edge, but it's cheap.

  21. Real-time geometry calculation by Anonymous Coward · · Score: 2, Interesting

    > It seems as if the geometries are calculated from scratch in real time.

    That wasy my initial thought, but (having watched it load, but not read the (F) article) now I'm thinking perhaps it's just an incremental load of a height field.

    The height-field v. polygon guess is also supported by seeing how bridges are handled - for example, with flat sides that include images of boats striped up them.

  22. Re:This just in... by Carewolf · · Score: 2, Interesting

    Cheap? It is 4 times more expensive than the F16, which is only a half generation behind Grippen, and twice as expense as the F16 2nd edition which is similar in technology to Grippen but bigger, faster and more powerfull.

    Sorry, butSweden is cheating themselves by insisting on using inferior local technology.

  23. stop making things up by nguy · · Score: 4, Informative

    Those images were created using a stereo camera and photogrammetry.

    http://citeseer.ist.psu.edu/267813.html

    Why do jerks like you insist on presenting things they imagine to be true as fact?