Slashdot Mirror


Microsoft's Augmented Reality, Video Photosynth

Al writes "Microsoft demonstrated new augmented-reality software for cell-phones at the 2009 TechFest conference, which was held this week in Redmond. Instead of using GPS or WiFi triangulation, the prototype system relies entirely on scene-recognition to identify its position and add virtual objects to a video picture of the real world. TechFest is a showcase for lots of projects at Microsoft's various research labs. Other technologies on show included Photosynth for video, an image-tracking system for handwriting, a way of refining image searches using colors, and a 3-D version of Microsoft Surface."

97 comments

  1. Who says.. by QuantumG · · Score: 4, Insightful

    Microsoft speeds too much money on research that they fail to turn into products.

    --
    How we know is more important than what we know.
    1. Re:Who says.. by TubeSteak · · Score: 1, Insightful

      Microsoft speeds too much money on research that they fail to turn into products.

      The visual processing algorithms they've developed are worth big bucks all by themselves.
      Even if Microsoft doesn't execute this 'right', now that the idea is out there, someone else will

      --
      [Fuck Beta]
      o0t!
    2. Re:Who says.. by djupedal · · Score: 3, Insightful

      > "The visual processing algorithms they've developed..."

      Not hardly. Please don't do that - don't start another MS myth.

      Algotithms such as these have been in existence since at least 2002 when 'Augmented Reality' (and display hardware) surfaced at domestic universities. The phrase was originated by Jaron Lanier, the founder of VPL Research - a respected outfit which was started in a Palo Alto cottage; 1984.

    3. Re:Who says.. by shawnap · · Score: 5, Funny

      ..., and a 3-D version of Microsoft Surface.

      Microsoft Volume?

    4. Re:Who says.. by Arthur+Grumbine · · Score: 3, Insightful

      > "The visual processing algorithms they've developed..."

      Not hardly. Please don't do that - don't start another MS myth.

      Algotithms such as these have been in existence since...

      Someone should have told Google back in 2000 that such a thing as a web search results algorithm already existed. Hell the phrase "search engine" had originated years before Larry and Sergey even thought of Google. Those fools thought they could make money off of improving a previously existing technology with their own patentable work--such silliness.

      Also, fuck you.

      --
      Now that I think about it, I'm pretty sure everything I just said is completely wrong.
    5. Re:Who says.. by Arthur+Grumbine · · Score: 1

      Microsoft Volume?

      I can't wait to see Ballmer get excited about that...

      --
      Now that I think about it, I'm pretty sure everything I just said is completely wrong.
    6. Re:Who says.. by Anonymous Coward · · Score: 0

      And here I thought all of the MS fanbois had finally handed over their plastic geek badges...

    7. Re:Who says.. by MrNaz · · Score: 2, Funny

      Yes, because any statement even orthogonally favoring Microsoft *must* be the work of a fanboi, and contain no rational point.

      Also, fuck you.

      --
      I hate printers.
    8. Re:Who says.. by symbolset · · Score: 0, Troll

      Let's chat about this again after they announce they spent $15M researching the perfect W7 sound theme, only to get "win-dows sev-en".

      I'd be reviewing those expense accounts. Do they always hold focus group meetings in a strip club? Couldn't they use a local one?

      --
      Help stamp out iliturcy.
    9. Re:Who says.. by Anonymous Coward · · Score: 0

      The same could be said for Google. I think the problem with Microsoft is they're too willing to turn many inferior creations into products and sell them anyway.

    10. Re:Who says.. by Anonymous Coward · · Score: 0

      Isn't this Wonderful...

      They are at least commited into trying to find new ideas... The only "bad" thing, is their corporate structure, which causes their "less profitable" projects to be canceled on the way.

    11. Re:Who says.. by ozmanjusri · · Score: 4, Funny
      I can't wait to see Ballmer get excited about that...

      Stand clear! Steve's going to squirt...

      --
      "I've got more toys than Teruhisa Kitahara."
    12. Re:Who says.. by sneilan · · Score: 0

      At least Google gives them away for free. Then again, google probably takes the data from their free products and somehow wrangles it back into search engine improvements.

      --
      "I like it when the red water comes out.."
    13. Re:Who says.. by moosesocks · · Score: 1

      Microsoft speeds too much money on research that they fail to turn into products.

      Well, they're one of the only companies left on the planet with a substantial "academic" research operation.

      Bell Labs and PARC might not have been profitable for their corporate overlords in the short-term, but produced research that had a profound impact on society at large.

      Microsoft may have some rather unsavory business practices (as did AT&T and Xerox), though I'd encourage them to continue to pump money into research as long as they're willing to.

      At the worst, it keeps geeks like us employed. At best, they discover something that propels us forward into the next epoch.

      Considering just how ass-backward most of Microsoft is, their research division has always impressed me.

      --
      -- If you try to fail and succeed, which have you done? - Uli's moose
    14. Re:Who says.. by im_thatoneguy · · Score: 1

      They're only worth big bucks thanks to patent law.

      Just saying.

      We all cheer pure R&D and then scream and cry when someone like microsoft defends their patents.

    15. Re:Who says.. by jo42 · · Score: 1

      Google almost went bankrupt before Larry and Sergey figured out bodging advertising to search. Today Google's primary business is advertising. Not search, not email, not maps, not anything else. They use the $$$$$$$$$$ from advertising to fund everything else they do to the point where they have become the 1000 pound gorilla that makes it next to impossible to compete with.

    16. Re:Who says.. by QuantumG · · Score: 0, Troll

      Err.. Heard of IBM? How about Sun Labs? Microsoft Research is a joke. It's where academic careers go to die.

      --
      How we know is more important than what we know.
    17. Re:Who says.. by Anonymous Coward · · Score: 0

      they bought them, my friend... http://phototour.cs.washington.edu/ but don't tell anybody!

    18. Re:Who says.. by Arthur+Grumbine · · Score: 1

      Perhaps you meant that they're primary revenue stream is from advertising. I absolutely agree. But they're primary focus (in terms of resources allocated) still remains in development/refining/protection-of their search results algorithm. The relevancy of their search results has always been their greatest product - without it all that advertising revenue would vanish. Advertising?! They haven't spent 1/2 the same time/energy managing their advertisers. They may not always be, but they have been so far, primarily a search engine.

      --
      Now that I think about it, I'm pretty sure everything I just said is completely wrong.
    19. Re:Who says.. by fel0niousmonk · · Score: 0

      Ever heard ... "If you can't do it, you teach it."

      I think you just proved your point, but I don't agree with the assertion that Microsoft is aiding in that endeavor.

      It's the nature of the beast, not the environment in which the beast thrives...

  2. I thought... by Darundal · · Score: 1

    ...Microsoft already had augmented reality tech running on everything? Seems to be the only explanation for about 1/2 of everything they do/

  3. Does Google use similar technology? by bogaboga · · Score: 1

    I have always wondered whether Google Maps uses similar technology. Otherwise how are they (Google) able to show continuously smooth images of a neighborhood?

    1. Re:Does Google use similar technology? by moniker127 · · Score: 2, Informative

      Simple. Images load in the background and fade in once loaded. They use DHTML. With proper coding, DHTML is a lot more powerful than people give it credit for being.

  4. I know by c00rdb · · Score: 1

    They should come out with videosmith, like songsmith but it generates a video for what you're singing!

  5. Blue Danube by gmuslera · · Score: 5, Funny

    When you see it with their cell phones, sometimes it suddently display a text with that background. Is like magic!

    Too bad that text starts saying "A problem has been detected and Window has been shut down"

    1. Re:Blue Danube by grgon · · Score: 1

      Too bad that text starts saying "A problem has been detected and Window has been shut down"

      http://www.petterbuhagen.com/portfolio/13.html

  6. Re:Copying Apple by Fallen+Seraph · · Score: 1

    Ummm, how about a link? Or a description? Or something? Not saying you're wrong, but I never heard about Apple looking into AR, and a quick Google search for Apple and "Augmented Reality" revealed no readily available information, other than a 3rd party application someone made on the iPhone running at 10FPS, which does not count as "Apple making it"

    In short: [citation needed]

  7. ARToolKit by Anonymous Coward · · Score: 0

    The ARToolKit which uses openGL has been around for several years. Many have begun the process of porting this over to cellphone architectures. I wouldn't be surprised to see this on cellphones more readily than it has been in the past several years.

  8. Micro Soft IV: A New Hope by konohitowa · · Score: 1

    Perhaps this is a sign that Redmond is finally starting to focus on being really good at a focused area instead of generally mediocre (or worse) at a huge number of things. It would be a welcome change. Now if we could just convince them that it's cool to port stuff to something non-Windows after a fashion. I don't have any issues with them releasing early versions of things for Windows, but refusing to open themselves up to a larger market is a bummer. I suppose they could make Windows enjoyable to use - in which case I wouldn't mind so much.

    1. Re:Micro Soft IV: A New Hope by moniker127 · · Score: 1

      That just isn't how microsoft operates, and it never will be. They are just too damned competitive, they must have their hand in every cookie jar. Its probably why they're so successful.

    2. Re:Micro Soft IV: A New Hope by fuzzyfuzzyfungus · · Score: 1

      I wouldn't be inclined to disagree with the notion that MS is improving in some areas(they could hardly go the other way); but is a scattershot exhibition of vaguely similar prototypes of assorted stuff from MS Research really a good sign of increased focus?

    3. Re:Micro Soft IV: A New Hope by jipn4 · · Score: 1

      Perhaps this is a sign that Redmond is finally starting to focus on being really good at a focused area instead of generally mediocre (or worse) at a huge number of things.

      So, you are saying that Microsoft should become a computer vision company? I don't think so.

      Besides, little of what they are showing is unique to Microsoft; lots of other companies and research groups have shown stitching and augmented reality.

  9. MS stealing "innovation" from Apple again by Anonymous Coward · · Score: 5, Funny

    Steve Jobs demonstrated the Reality Distortion Field as far back as 1982, when he took over the Macintosh project.

  10. Re:Copying Apple by moniker127 · · Score: 1

    I wonder if it is the same AC that says this every time microsoft invents something.
    Just because you don't like microsoft does not mean they have never pushed the envelope. They do it all the time.

  11. Wikitude already does this by decavolt · · Score: 1

    So... instead of using wifi and GPS for pinpoint accurate pinpoint awareness, Microsoft's answer is of course the less efficient and error prone one: nothing but image recognition. How will this perform in low light conditions or areas that haven't been previously photographed and added to the database?

    I already have Wikitude on my Android phone and it's outstanding, so I don't see a breakthrough or any innovation here. Just another example of MS doing things the harder, slower, more error-prone way and calling it "innovation."

    1. Re:Wikitude already does this by Atlantis-Rising · · Score: 1

      Wikitude is a totally different concept.

      What Microsoft is going for here is twofold: Firstly, being able to locate where an image was taken by simply analyzing the image (this could be pictures from a history book, or your family photo album- something for which location data was not available)

      Secondly, being able to specify. GPS, Wifi, and cell tower triangulation become very much less accurate in large cities. Analysis based on pictures could be very much more accurate, with a sufficient number of images to analyze for positional data.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    2. Re:Wikitude already does this by Anonymous Coward · · Score: 0

      You obviously have no idea what 'innovation' is. Where do you think GPS and wifi came from? Maybe you're like... 12 years old... or something (Your attitude certainly implies it), but us old farts remember when GPS was accurate to 30m (that's 60 feet, in case you haven't made it that far in primary yet). Good luck doing AR with that. Not to mention, when was the last time you tried to use your GPS indoors in a non-metropolitan area (with augmenting)?

      I'm sorry you're too naive to realize that products are an incremental progression from something that works poorly, and don't spring fully formed on to the shelves by magic.

      Your attitude is the reason the US is failing at research.

  12. Rainbows End by ShakaUVM · · Score: 2, Interesting

    Reminds me of a book I read last month, Rainbows End.

    People run around with 3d goggles on that overlays 3d graphics over the real world, for work and fun.

    The author lives here in San Diego, so it was fun to hear him talking about people overlaying Terry Pratchett-style graphics over the interstates I drive on all the time.

    1. Re:Rainbows End by Anonymous Coward · · Score: 1, Interesting

      Many years before i really heard much about AR i thought how it would be cool to have a pair of glasses and a pocket computer that would overlay graphics, always thought it would be cool to play certain games in the real world, like zombie outbreak, imagine how fun and freaky that would be, you might look like silly to anyone around you but eventually it would catch on.

      I believe this will be the next big thing since the internet and mobile phones so companies really need to put more effort into bringing it to us.

    2. Re:Rainbows End by Anonymous Coward · · Score: 0

      pair of glasses[...]zombie outbreak

      They Live!

      Though, I think they were aliens that looked like zombies.

    3. Re:Rainbows End by religious+freak · · Score: 1

      Yeah, funny thing is I read that and thought "well this will likely take longer than a decade and a half to see" (I read it when it first came out - I think the book was based in about 2023, IIRC).

      I didn't think we were anything close to that. I'd never heard of augmented reality before. I'm amazed they are this far along... 12 month double... double that in 12 mos... double... double... etc, etc... Hell we might actually get there!

      Hardware is very predictable, but software isn't. I didn't think we would be able to get this far by now. Interesting...

      --
      If you can read this... 01110101 01110010 00100000 01100001 00100000 01100111 01100101 01100101 01101011
  13. Background on Photosynth by 1+a+bee · · Score: 1
    If you're wondering Hadn't I seen something like this before? you're not alone. Photosynth has been covered numerous times here on /.: Goog search

    A choice video demo-ing the original technology can be found here.

  14. Re:Copying Apple by perryizgr8 · · Score: 2, Insightful

    i think you did more research than gp.

    --
    Wealth is the gift that keeps on giving.
  15. Re:Microsoft business strategy by Anonymous Coward · · Score: 0

    Wow. You must be extremely limber. A master yogi probably couldn't have equaled that incredible stretch. But no worries - I'm sure she weighs the same as a duck... and so forth.

  16. Video clip by DuranDuran · · Score: 1

    Not mentioned in either of the two original links, but this page features a clip of the augmented reality technology:

    http://gamesalfresco.com/2009/02/24/microsoft-to-demo-augmented-reality-at-techfest/

    --
    "You can justify anything by putting it in quotes, adding a famous name and making it a sig" - Albert Einstein
  17. AR Quake by burnin1965 · · Score: 1

    This reminds me of the Altered Reality Quake suit that was mentioned in a 2002 slashdot article.

    1. Re:AR Quake by SethJohnson · · Score: 1

      That AR Quake is really cool. I wish the framerate on their video captures didn't suck so much, though. If I could map out a course around my neighborhood, I'd be more inclined to go out and run for exercise.

      Seth

  18. Steve Jobs in "Weekend at Steve's" by Anonymous Coward · · Score: 0

    Steve Jobs is coming back in the summer-time theatrical release of

      WEEKEND AT STEVE'S

    a rip-roaring tale of intrique and espionage, by the famed producers of "Weekend at Bernie's" and "Uncle Ernie's Holiday Camp". Rated PG-13, so bring the kids, and bring your hankey, you'll need it! So much fun for the entire family. Coming this summer!

  19. Reality no longer good enough by Walaci · · Score: 2, Interesting

    My concern, as Luddite as it sounds, is that it takes us further and further from reality. It augments our perception of what reality really is. Nothing will be satisfying enough unless it has an overlay on it, apparently adding "value", but in reality, detracting from it. Sure there will be benefits from such technology, but everything is a two-edged sword.

    1. Re:Reality no longer good enough by hoooocheymomma · · Score: 5, Funny

      Sure there will be benefits from such technology, but everything is a two-edged sword.

      except for single-edged swords

    2. Re:Reality no longer good enough by Mia'cova · · Score: 1

      Sure it detracts in reality but what about in augmented reality? :)

      But really, I don't get your point. Who wouldn't want to replace physical billboards and crap with virtual information? Let's clean shit up so you don't have to waste your time trying to figure things out everywhere you go. Sounds good to me!

    3. Re:Reality no longer good enough by nyctopterus · · Score: 1

      Well, one thing to consider is that our senses only grasp a small part of reality, and in a rather warped way too. Augmentation might let us see more reality, or a less biased version of it.

    4. Re:Reality no longer good enough by redxxx · · Score: 1

      At the very least, it's a lot of extra information to be taking in. Once someone is adjusted to it, it's absence could, in some cases, be uncomfortable.

      I don't really know about the "Nothing will be satisfying enough unless it has an overlay on it", I figure I'd treat them like horrible webpages and run RealityMonkey(tm). The bigger issue is at some point I'm going to have to take them off. If you think crackberries are bad, good AR is going to be about a hundred times worse(obviously they'd be used for all sorts of communication in addition to just the AR role and bring the web closer than your fingertips).

    5. Re:Reality no longer good enough by Anonymous Coward · · Score: 0

      The thing about single-edged swords is you have to turn the blade to cut the other way, but on the other hand you are less likely to cut yourself. I guess it's a two-edged sword

    6. Re:Reality no longer good enough by An+ominous+Cow+art · · Score: 2, Funny

      ... and zero-edged maces.

    7. Re:Reality no longer good enough by Kattspya · · Score: 1

      It sounds luddite because it is luddite. The same has been said just about everything new, that it removes us from nature, that it distances us from our humanity or that it creates a dependence on something new.

      You could easily apply your argument to say cellphones or the automobile. The cellphone seemingly adds value by enabling us to communicate at any time but in reality it detracts from the value of real conversation. The automobile apparently adds value but in reality it detracts from the value of a four hour treck to go swimming.

    8. Re:Reality no longer good enough by Walaci · · Score: 1

      Yes, everything is a two edged sword. It's easier to see into the near future than the distant future... who knows how much long term pain balances short term gain?

    9. Re:Reality no longer good enough by Kattspya · · Score: 1

      Both of my examples were picked to be obviously false. I'm of the opinion that progress is generally a single edged sword in the long term.

  20. Re:Microsoft business strategy by Anonymous Coward · · Score: 0

    and also, fuck him!

  21. Augmentation safety by Anonymous Coward · · Score: 0

    Warning: The building you are about to enter may contain a virus. Are you sure you want to proceed?

    1. Re:Augmentation safety by jaxtherat · · Score: 1

      Warning: The building you are about to enter may contain a virus. Are you sure you want to proceed?

      >> Yes
      You enter the building. You were eaten by a grue.

      --
      http://www.zombieapocalypse.tv/
  22. OK, that really was a troll by symbolset · · Score: 1

    That was fair.

    Anybody got a link to the swarm of news reports about the millions they spend on Vista's startup sound? I'm Googling it and apparently it's been deleted from the Internet.

    I can't be the only one who remembers that theatre of the absurd. And really - how do you delete stuff from the Internet, anyway?

    --
    Help stamp out iliturcy.
    1. Re:OK, that really was a troll by ozmanjusri · · Score: 0, Troll
      I'm Googling it and apparently it's been deleted from the Internet.

      It's odd that the commentary has vanished, but the original interview site still exists.

      "I knew from day one that it would be a tricky process," says project maestro Steve Ball, group program manager for Vista. In the end, it took 18 months--and a team of 20 composers, sound designers, engineers, and developers.

      --
      "I've got more toys than Teruhisa Kitahara."
  23. stitching is old tech by jipn4 · · Score: 2, Insightful

    I have always wondered whether Google Maps uses similar technology.

    Image stitching has been around for a long time, and Photosynth is based on a lot of technology and research developed elsewhere.

    Photosynth caught on because (1) there are lots of images to stitch now, (2) because they did a good engineering job stitching images that were taken under different conditions, and (3) they did a good engineering job on the UI.

  24. Microsoft Research? Give me a break... by V!NCENT · · Score: 1

    I've played a game on a Nokia phone that utilises the camera and some software just like this too. you then need to turn around (yourself with the phone in your hand) to shoot down enemies from all around you (including up and downlooking too). The software was even sophisticated enough to understand walls and objects in RL that enemies could hide behind!

    --
    Here be signatures
    1. Re:Microsoft Research? Give me a break... by Anonymous Coward · · Score: 0

      May it be "Mosquito" ? I remember having played it about 4 years ago...

    2. Re:Microsoft Research? Give me a break... by lw0x15 · · Score: 1

      Which phone is that ? one of the newer ones i guess..? You got me pretty interested.

    3. Re:Microsoft Research? Give me a break... by V!NCENT · · Score: 1

      It's just software... It was a downloadable java game from a third party developper and I played it on a Nokia n95 I believe.

      --
      Here be signatures
  25. Re:Copying Apple by ozmanjusri · · Score: 1
    they have never pushed the envelope. They do it all the time.

    Examples?

    --
    "I've got more toys than Teruhisa Kitahara."
  26. nt by Anonymous Coward · · Score: 0

    nt

  27. Love the bubbles! by Anonymous Coward · · Score: 0

    Great nonintrusive interface. Now if someone could come up with an opensource version.

  28. Re:Copying Apple by Anonymous Coward · · Score: 0

    Antitust Legal Defense
    Open Standards Engineering
    Intraoperability
    Digital Rights Management
    Patent Law

  29. Re:Copying Apple by Anonymous Coward · · Score: 0

    Examples of when microsoft has come out with a product years ahead of its time:

    Windows 95

    Windows 95 was the first real windows in my opinion. It defined (for many years) what an operating system is, what it looks like, and what it does.

    Every version of DirectX introduces dozens of new features that changes the gaming industry in a big way. If openGL were the only common graphics language, we would be years behind where we are, mostly because of petty bickering.

    Microsoft's new OS Singularity is a research project that is testing a complete new operating system paradigm. Running all managed code, singularity is designed to be a super-stable OS.

    Sure, you can always point and laugh at things like bob, me, vista, but like it or not microsoft HAS drastically changed the way the industry would have looked. I'm sure in many minds the world would be better off without microsoft, but I dont think that is the case.
     

  30. Re:Copying Apple by moniker127 · · Score: 1

    Whoops I posted the second comment, forgot to login.

  31. Already been done... by mdm-adph · · Score: 1

    There were some guys doing this for the Google developer's contest on Android back in the day: http://www.enkin.net/

    There's a video that shows you how well it worked -- don't know what happened to them, though.

    --
    It is by my will alone my thoughts acquire motion; it is by the juice of the coffee bean that the thoughts acquire speed
  32. kneejerkism at its strongest by MisterSquid · · Score: 2, Insightful
    Also, fuck you.

    The point of your parent is that crediting Microsoft with pioneering these algorithms is sort of akin to saying Al Gore invented the Internet.

    While Microsoft may have in fact taken augmented reality into the domain of cellphones and made the tech more accessible and mainstream, they should not be credited with inventing the technology.

    None of this is to say that the grandparent (TubeSteak's post) suggests Microsoft invented this technology. I'm only pointing out that all of this defensive and aggressiveness over Microsoft is really unhealthy and, more importantly, unnecessary.

    --
    blog
  33. Re:Copying Apple by thePowerOfGrayskull · · Score: 1

    Microsoft's new OS Singularity is a research project that is testing a complete new operating system paradigm. Running all managed code, singularity is designed to be a super-stable OS

    'cause nobody ever thought to create(2003) one of those (1996) before...

  34. Microsoft Research: Creators of...well, not much by woohootoo · · Score: 1

    Isn't this photo thing nothing more than replacing a simple solution (GPS) with an extremely complicated one??? Way to go, MR! Your string of impractical duds continues.

  35. Re:Copying Apple by Anonymous Coward · · Score: 0

    JavaOS? LOL. Thanks for letting people know you have no clue about operating system design. I'd suggest you take a intro level course before you open your mouth on this topic.

    But hey, feel free to put another foot in your mouth.....

  36. Please note by Anonymous Coward · · Score: 0

    Please note that decavolt is a known anti-ms troll. That is all. Bye.

  37. What, no Shadowrun reference yet? by TwoQuestions · · Score: 1

    That was the first place I ever heard of Augmented Reality. Really though, I'm just a bit afraid of AR obscuring what needs to be seen when walking down the street, kind of like how some FPS games make you play through this little window that isn't obscured by the HUD.

  38. Re:Copying Apple by thePowerOfGrayskull · · Score: 1

    LOL. Thanks for letting people know you have no clue about operating system design.

    Maybe you should do a bit of reading? Parts (though not all) of the JavaOS kernel are implemented in java. In concept, this predates Singularity by many years.

    And nice how you ignored jnode; that pure java OS implementation was officially begin in 2003 (same year as Singularity) but had its origins in a project that dated to before 2003.

    I'd suggest you take a intro level course before you open your mouth on this topic. But hey, feel free to put another foot in your mouth.....

    I can see how you'd ignore it though, as acknowledging it would mean you had no opportunity to vomit out insults at strangers on the intarwebs. Maybe once you get out of school, you'll develop some real-world research skills?

    Aw, poop. Now you've got me doing it too.