Slashdot Mirror


"Holographic" Desk Allows Interaction With Virtual Objects

Zibodiz writes "The Sensors and Devices group at Microsoft Research has developed a new system called HoloDesk that allows users to pick up, move and even shoot virtual 3D objects. It's about the size of a filing cabinet and is made up of an overhead screen that projects a 2D image through a half-silvered beam splitter into a viewing area beneath. A Kinect camera keeps tabs on a user's hand position within the 3D virtual environment, a webcam tracks the user's face to help with placement accuracy, and custom algorithms bring everything together in (something very close to) real time."

85 comments

  1. HoloDesk? by Esion+Modnar · · Score: 0

    Doesn't Paramount own the trademark on HoloDeck? And would this be too close for comfort?

    --

    They say the first thing to go is your penis. Well, it's either that or your brain. I forget which...
    1. Re:HoloDesk? by Oswald+McWeany · · Score: 1

      First they would have to prove that people are confused by the name and mix it up with a product produced by Star Fleet.

      I don't think anyone will make the honest mistake of thinking this product was produced by a 25th century institution.

      However, I'm sure if Apple were to buy Paramount they would sue anyway. Especially if this device has rounded corners, an on/off switch, or limited buttons.

      --
      "That's the way to do it" - Punch
    2. Re:HoloDesk? by jkirch · · Score: 1

      As far as lawsuits are concerned, I'm more worried about someone giving Picard access to one of these, a 1920's bar simulation and a machine gun. Is it still assault with a deadly weapon if it's virtual?

    3. Re:HoloDesk? by derGoldstein · · Score: 1

      There's no force-feedback yet. You can interact with object in the environment, but you can't feel them. So this is of no interest to Picard, or the porn industry, for now.

      --
      Entomologically speaking, the spider is not a bug, it's a feature.
    4. Re:HoloDesk? by Anonymous Coward · · Score: 0

      This IS America after all. There are large swaths of the population who believe that dinosaurs roamed the earth with humans and that evolution is a crock.

    5. Re:HoloDesk? by Dunbal · · Score: 1

      Trademark? It would be hard to defend a trademark of something that doesn't exist, much less hasn't ever been traded. When they start selling holo-decks maybe they will have a case. Now copyright, on the other hand, might be a problem.

      --
      Seven puppies were harmed during the making of this post.
    6. Re:HoloDesk? by Dunbal · · Score: 1

      And can be photoshopped to be the same size as one of their products.

      --
      Seven puppies were harmed during the making of this post.
    7. Re:HoloDesk? by Oswald+McWeany · · Score: 1

      Funny... my first thought was that this would have no interest for "the industry" therefore the technology was doomed.

      --
      "That's the way to do it" - Punch
    8. Re:HoloDesk? by Anonymous Coward · · Score: 0

      But humans did roam the earth at the same time as dinosaurs! Don't you watch Terra Nova?

    9. Re:HoloDesk? by omnichad · · Score: 1

      Google didn't think twice about naming their failed messaging service Wave in reference to the communications in Firefly. Of course, I'm not sure which lasted longer - Google Wave or Firefly. Maybe there'll be a movie.

    10. Re:HoloDesk? by pluther · · Score: 1

      I don't think anyone will make the honest mistake of thinking this product was produced by a 25th century institution.

      I think you overestimate people's average intelligence...

      --
      If the masses can keep you down, you're not the Ubermensch.
    11. Re:HoloDesk? by hawguy · · Score: 4, Informative

      There's no force-feedback yet. You can interact with object in the environment, but you can't feel them. So this is of no interest to Picard, or the porn industry, for now.

      Not on this one, but the University of Tokyo is coming closer to force feedback using ultrasound:

      http://www.gizmag.com/tactile-holographic-display/12466/

    12. Re:HoloDesk? by hawguy · · Score: 1

      But humans did roam the earth at the same time as dinosaurs! Don't you watch Terra Nova?

      And don't forget Land of the Lost. Even if you disregard the time-traveling modern humans, the show clearly documented early cavemen (i.e. Cha-Ka) living with dinosaurs.

    13. Re:HoloDesk? by Lanteran · · Score: 1

      24th :P

      --
      "People don't want to learn linux" hasn't been a valid excuse since '03.
    14. Re:HoloDesk? by arisvega · · Score: 1

      .. no interest for "the industry" ..

      Isn't it called "the business" ?

      --
      The three laws of thermodynamics:(1) You can't win. (2) You can't break even. (3) You can't even quit.
  2. Point Cloud ? by UnknownSoldier · · Score: 3, Insightful

    I'm surprised they are using a point cloud and not a mesh for the tracking? That would explain why the physics seems a little unstable / jumpy when the ball floats around on the book.

    Cool prototype -- will be real interesting to see what kind of applications get developed once this tech is cheap enough where every home has one.

    1. Re:Point Cloud ? by derGoldstein · · Score: 3, Interesting

      This is a shot in the dark, but: interacting meshes would involve specific collision detection between surfaces, which (when scanning an object in real time) could lead to locked models (the virtual object could "stick" to you, or other objects). A particle system allows them to define "particles repel each other" and get around that problem. Notice how (relatively) large the particles themselves are -- I'm guessing it can only deal with a limited amount of particles within the environment at the same time.
      (and yes, I realize that the size of the particles you see doesn't necessarily mean that this is what the program is doing, but the number of particles probably is)

      --
      Entomologically speaking, the spider is not a bug, it's a feature.
    2. Re:Point Cloud ? by nomel · · Score: 1

      Nice point! But, I imagine it comes from plug in solution that the kinect is. Why would they want to make a custom solution? JUST KIDDING! Although, this seems to be the modern mindset, which is perfectly fine for interesting idea creation.

      Call me unimaginative, but I picture vr glasses as becoming cheaper before something the size of a cabinet does.

    3. Re:Point Cloud ? by derGoldstein · · Score: 1

      The two aren't mutually exclusive. Certainly, the glasses will be cheaper and easier to produce, but even if you create a surface like that which is only a single "slab", there will still be scenarios where there's just no room, and the glasses will be the only option.
      Of course, it's possible that someday you could get the same effect with a pico-projector, but doing the 3D scanning *and* 3D projecting from a single point really is sci-fi, for now.

      --
      Entomologically speaking, the spider is not a bug, it's a feature.
    4. Re:Point Cloud ? by Anonymous Coward · · Score: 0

      I'm guessing it can only deal with a limited amount of particles within the environment at the same time.

      That's why I try to avoid computers, finite numbers are boring.

  3. Games by psydeshow · · Score: 1

    Oooh, I can't wait to play "Operation" on one of these!

    1. Re:Games by Yvan256 · · Score: 1

      And I can't wait to play Leisure Suit Larry on one of these.

    2. Re:Games by Anonymous Coward · · Score: 0

      "Hey babe, wanna play with my balls?"

    3. Re:Games by iluvcapra · · Score: 1

      Nor can your surgeon.

      --
      Don't blame me, I voted for Baltar.
  4. Aw Bob grows up by ToasterTester · · Score: 1, Funny

    Sure sounds like rebirth of MS Bob. MS never lets old code go to waste, wait long enough the idea will come around again.

    1. Re:Aw Bob grows up by shadowfaxcrx · · Score: 1

      The next step is for a holographic full-sized office with a holographic representation of a laptop on the desk ;)

      --
      "I disagree with you" does not equal "flamebait."
    2. Re:Aw Bob grows up by derGoldstein · · Score: 1
      --
      Entomologically speaking, the spider is not a bug, it's a feature.
    3. Re:Aw Bob grows up by derGoldstein · · Score: 1

      Damn it, I posted too soon... Replace with "yo dawg"

      --
      Entomologically speaking, the spider is not a bug, it's a feature.
    4. Re:Aw Bob grows up by unixisc · · Score: 1

      Can one put a virtual machine on the desk ;-)

    5. Re:Aw Bob grows up by shadowfaxcrx · · Score: 1

      It's virtually guaranteed that they will some day ;)

      --
      "I disagree with you" does not equal "flamebait."
  5. StarWars by keehun · · Score: 1

    The graphics on the display really look like the stuff from Star Wars (original trilogy) where the chess pieces attack each and kill each other

  6. Already been done.... back in 98 by Anonymous Coward · · Score: 3, Informative

    I worked for the Electronics Visualization Laboratory, back in the late 90's. We developed a similar system called PARIS,some time around 1998.

    http://www.evl.uic.edu/core.php?mod=4&type=1&indi=83

    1. Re:Already been done.... back in 98 by vlm · · Score: 1

      I saw a movie of this in '93 at a IEEE meeting, could be one of your early prototypes, could be you were not the first, hard to say.

      --
      "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
    2. Re:Already been done.... back in 98 by vlm · · Score: 1

      Ha I found it "digitaldesk" all one word.

      http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-330.html

      http://video.google.com/videoplay?docid=5772530828816089246

      I believe this movie dated june 1991 is the actual movie I watched in '93 at the IEEE meeting

      http://www.youtube.com/watch?v=S8lCetZ_57g

      The movie is well worth watching and I promise my immortal /. Karma that it is not a rickroll.

      Other than resolution and 3d acceleration, nothing has really changed in the past 20 years WRT this specific technology.

      --
      "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
    3. Re:Already been done.... back in 98 by Anonymous Coward · · Score: 0

      What is your stupid point anyway? That nobody should improve upon anything? If you apply some thought you'd realize that there is little in common between what you did and what this is, much like the Model-T and a Ferrari.

      I'm relatively glad that your anti-progress mindset isn't adopted by anyone sane.

    4. Re:Already been done.... back in 98 by Anonymous Coward · · Score: 0

      Silicon Graphics has a Holodesk in the mid to late 90's as well...

  7. Now where did I leave that virtual stapler by richardkelleher · · Score: 1

    I have a handful of virtual papers I need to staple and someone stole my virtual stapler. Well, I better check the virtual drawer for a virtual paper clip.

    1. Re:Now where did I leave that virtual stapler by ganjadude · · Score: 1

      no need to bring clippy into this

      --
      have you seen my sig? there are many others like it but none that are the same
    2. Re:Now where did I leave that virtual stapler by Amouth · · Score: 4, Funny

      nooooooo don't let clippy out of there or we are all doomed

      --
      '...if only "Jumping to a Conclusion" was an event in the Olympics.'
    3. Re:Now where did I leave that virtual stapler by Talderas · · Score: 1

      I see you are attempted to create a holographic environment. Would you like some help?

      --
      "Lack of speed can be overcome. In the worst case by patience." --Znork
    4. Re:Now where did I leave that virtual stapler by richardkelleher · · Score: 1

      I apologize to anyone I may have frightened by my use of the "c" word in my post. Please mentally replace the "c" word with Acco Clip. Again, I apologize profoundly. It was thoughtless on my part.

  8. Pfffft by cornface · · Score: 1

    I am working on a system that lets you manipulate objects on a desktop, but contains both 3D objects and immediate and realistic tactile sensation.

    The best part is the objects are completely functional. For instance, I have a pencil object right now that will write on a paper object and dull itself over time. It is realistically modeled in wood.

    I've also implemented drawers which can be used to organize and store the objects for later retrieval, as well as a rudimentary file system.

    I'm not entirely sure what to call it yet, but I'm thinking of going with "a desk."

    1. Re:Pfffft by omnichad · · Score: 1

      Yeah, and could you do a fully interactive read of an MRI with one of those? Would be very useful to push and prod and turn 3D scans, and peel away layers. There's plenty more applications.

    2. Re:Pfffft by cornface · · Score: 1

      I think it is unrealistic to expect a wooden desk to process MRI images when the human brain itself is often incapable of processing a "joke."

  9. Paging Johnny Mnemonic by blair1q · · Score: 1

    Now we're talking.

  10. Insert joke here by amliebsch · · Score: 0

    It appears you are posting a reply to a story about Microsoft. Please select one or more of the following unfunny references:

    o 640 K of memory
    o Chair throwing
    o Blue something of death
    o Microsoft Bob

    Do not include a punchline.

    --
    If you don't know where you are going, you will wind up somewhere else.
    1. Re:Insert joke here by derGoldstein · · Score: 1

      You forgot clippy and "squirting".

      --
      Entomologically speaking, the spider is not a bug, it's a feature.
  11. Slashdot Logos by mfwitten · · Score: 1

    Have the Slashdot story logos gone banal all of a sudden?

    What happened to The Borg Gates?

    Even the story about Gates's reinvention of the toilet uses some boring stock photo.

    1. Re:Slashdot Logos by Anonymous Coward · · Score: 0

      People complained that Borg Gates was ridiculously dated, now people say that they miss it...

  12. Awesome game ideas! by falzer · · Score: 1

    Just imagine: virtual hand-washing dishes, virtual weed pulling, virtual pebble sorting.
    The video-game possibilities are endless!

    1. Re:Awesome game ideas! by omnichad · · Score: 1

      We all knew Facebook 3rd-party developers would capitalize on it eventually.

  13. Applications for science by Anonymous Coward · · Score: 1

    I'm going through the Organic Chemistry sequence in college right now and I find the one of the most difficult ideas to present to students (myself and my classmates) is the 3D spatial arrangement of molecules.

    If the professor had access to one of these Holodesks during a lecture he could rotate enantiomers as well as perform reactions in real time which could be a huge boon for anyone having trouble with regiochemistry.

  14. When did Microsoft stories by wiredog · · Score: 0

    Lose the Borg logo?

    1. Re:When did Microsoft stories by Anonymous Coward · · Score: 0

      Yeah, at least you could cross out "Micro" and write (red sharpie) in "Fail" below it

  15. Sorry by Dunbal · · Score: 1, Interesting

    I fail to see the practical applications of this. I mean yeah, instead of relying on sensors that are orders of magnitude more sensitive or precise than the human hand, let's re-create a virtual world with a bad physics system and let people use their extremely low resolution hands to do things that they could do for real with real objects. I mean short of being a toy, what is the point?

    --
    Seven puppies were harmed during the making of this post.
    1. Re:Sorry by Anonymous Coward · · Score: 0

      Somewhere between the drawing board and real world product lies things such as proof of concept and prototype. You don't go from no Holodeck to having a Holodeck without intermediate steps in between that aren't viable.

    2. Re:Sorry by Anonymous Coward · · Score: 0

      I fail to see the practical applications of this. I mean yeah, instead of relying on sensors that are orders of magnitude more sensitive or precise than the human hand, let's re-create a virtual world with a bad physics system and let people use their extremely low resolution hands to do things that they could do for real with real objects. I mean short of being a toy, what is the point?

      You're right - any sort of innovation or invention MUST have a practical use. Proof of concepts are ALWAYS a waste of time, unless your creation is immediately useful then you should be ashamed of yourself and not allowed to do any sort of invention ever again.

    3. Re:Sorry by Anonymous Coward · · Score: 0

      I fail to see the practical applications of this. I mean yeah, instead of relying on sensors that are orders of magnitude more sensitive or precise than the human hand, let's re-create a virtual world with a bad physics system and let people use their extremely low resolution hands to do things that they could do for real with real objects. I mean short of being a toy, what is the point?

      No practical application? Because, yeah no one needs more space on their (computer) desktop than their monitor provides. I can see work desks / stations and conference tables making use of this technology. A larger 3D desktop where items can be manipulated, displayed and kept handy just might be good. The desktop could be "shared" for view or work across multiple stations as well. 3D goggles / glasses could do this as well, but then you have limited viewing to one person (or at least those with goggles). It helps to have an imagination when considering the eventual uses of research work.

    4. Re:Sorry by Dunbal · · Score: 1

      any sort of innovation or invention MUST have a practical use.

      No, but it must provide a foreseeable return on investment if you expect the idea to ever leave the prototype stage. It's easy to beg for money for projects. It's hard to take projects and turn them into money. How can this be turned into money?

      --
      Seven puppies were harmed during the making of this post.
    5. Re:Sorry by JMZero · · Score: 3, Insightful

      instead of relying on sensors that are orders of magnitude more sensitive or precise than the human hand

      The hand isn't a sensor at all in this context; rather, the manipulations of the hand are picked up by distinctly non-hand sensors. It's clear the current limit on this system is those sensors, computers, and software - all of which could improve quickly if this moved beyond research.

      extremely low resolution hands

      My hands have, uh... pretty high resolution. Are your hands kind of blocky? Do they show aliasing when you turn them? More to the point, humans are extremely adept at doing fine manipulation with their hands and these manipulations are extremely intuitive. If they could make this work very well, I see no reason it couldn't be used for a bunch of things: teaching and demonstrating, as an intuitive UI for controlling robots (that might actually be acting on smaller or larger or toxic or distant objects in real life), or for experimenting with possible approaches or designs.

      It doesn't take much imagination to come up with possible applications for this.

      That said, probably it will never come to anything (at least not in a similar form) or not for a while. But if you disapprove because you fail to see practical applications now, I think you're both wrong (in this case) and misguided (in the general case). I think it's cool MS is doing research that they probably can't exploit immediately. It shows foresight to be thinking about interface methods before they're really practical. Nintendo (or whoever they bought tech from) probably had some very crappy Wii-like peripherals in research long before they worked well enough to sell. It might take 100 ideas and prototypes like this to find 1 that is the next big thing. But that's how we get cool new stuff.

      Disregarding all that, even if it was completely pointless (and I don't think it is) I think it's fun that we can see it and discuss it on a site that is about interesting technology.

      I mean short of being a toy, what is the point?

      Do you mean "beyond being a toy"? If so, you said the exact opposite thing. Or do you not think this would fall short of working as a toy? Because it seems to me like it works as a toy right now.

      --
      Let's not stir that bag of worms...
    6. Re:Sorry by MikeUW · · Score: 1

      That's right - all research and development is done because we already what the ROI will be in the end. In fact, we don't even need to do this R&D anymore...we should just be going straight to the R on the I, and skip all the stuff that comes between ideas and the the final, polished product or implementation. Now if only we could somehow research and develop a way to actually accomplish this feat...anyone have a proof of concept for this?

  16. What is the Microsoft you speak of? by Anonymous Coward · · Score: 0

    Where's my borg?

  17. Hollographic monitor from the stadium by Anonymous Coward · · Score: 0

    My holographic monitor, i watched this video on, was too large to fit in my room (and i am at the stadium as you can notice). :)

  18. Like Surface... by roc97007 · · Score: 1, Insightful

    ...you'll see it in demos and as a prop for TV series but it'll never be something you can actually buy. It's just M$ egoware. Nothing to see here. Move along.

    --
    Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    1. Re:Like Surface... by bejiitas_wrath · · Score: 1

      CSI will jump on this for sure...

      --
      liberare massarum ex ignorantia, clausa descendit molestie.
  19. Bring back the Borg Gates! by Alex+Belits · · Score: 1

    Seriously, bring back that thing.

    --
    Contrary to the popular belief, there indeed is no God.
    1. Re:Bring back the Borg Gates! by Anonymous Coward · · Score: 0

      Microsoft is no longer "the borg". Every tech company now is. Also, bill gates retired like 10 years ago.

      It's not accurate any more.

    2. Re:Bring back the Borg Gates! by Anonymous Coward · · Score: 0

      I always thought that borg-gates thing was stupid.. but I would support bringing it back provided they start using a "Steve Jobs wearing a strap-on" logo for Apple articles.

    3. Re:Bring back the Borg Gates! by Archwyrm · · Score: 1

      You'd be naive to believe they don't have a few robotic Gates' stashed away somewhere "just in case".

      --
      Fascism should more properly be called corporatism because it is the merger of state and corporate power. -- Mussolini
  20. So much MS Hate... by Anonymous Coward · · Score: 0

    If this was developed with a Linux system you guys would all be harping about all the practicle applications and uses this could have in the future...

    1. Re:So much MS Hate... by Archwyrm · · Score: 1

      That's because you can actually get some work done on a good Linux distro, instead of spending all your time rebooting and getting popups out of your face.

      --
      Fascism should more properly be called corporatism because it is the merger of state and corporate power. -- Mussolini
  21. Pron by thomasw_lrd · · Score: 0

    Does anybody else see hiding this from the wife a problem? Give it to some porn websites and let them work out the details, and they'll have a commercially viable product in 6 months.

    1. Re:Pron by Shompol · · Score: 1

      Does anybody else see hiding this from the wife a problem? Give it to some porn websites and let them work out the details, and they'll have a commercially viable product in 6 months.

      Except this technology exists since 1998. Pron industry had 13 years to take it for free, but now that MS claimed it to be their latest "innovation" you have to pay them rent for it every time you buy a non-Windows computer. (MS does not specify what patents it collects rent on, so this one might be among them).

  22. HoloDesk? I have dyslexia damn it! by MichaelJE2 · · Score: 1

    Did anyone else misread that as holodeck, not desk? Way to get my hopes up summary.

  23. Useful in combination with... by Anonymous Coward · · Score: 0

    Haptic technology. You wear a glove which applies pressure to your hand in the right spots, and voila! The only difference between this and real life is... well, nothing, besides the fact that you can't take the object out of the HoloDesk.

    This has a tremendous amount of applications, namely (as mentioned in the video) long-distance collaboration and prototyping.

    Sure the physics is buggy right now, but it's just a prototype, and it's using a Kinect for video. Something much more accurate could be used instead.

  24. Re:Not related to holography, at all. by miknix · · Score: 1

    D. Gabor and Denisuk would be sad about this incorrect usage of "holography" in the summary..

  25. Who cares about a Holographic desk, by Anonymous Coward · · Score: 0

    I want to know when they release a holographic bed.

  26. Shopping... by Glarimore · · Score: 1

    This kind of technology will completely change the marketplace.

    If these get cheap enough that you can put one of these in your house, it would give you the ability to handle a virtual version of whatever item you wanted to buy... before you bought it! If these machines were accurate and sensitive enough (and had the computational power) you could even interact with a virtual version of say, a mobile phone. You wouldn't be able to actually "feel" anything you you were handling, but it sure beats the hell out of a jpeg.

  27. I've always wanted a 3D weather applet by Provocateur · · Score: 1

    and visualize the thunderstorm right there on the edge of my desktop, as it as it lurches towards Virginia.

    --
    WARNING: Smartphones have side effects--most of them undocumented.
  28. 3-Some by Anonymous Coward · · Score: 0

    If me and my friend are fondling my holobabe does that count as a 3-some?

  29. Holochair by Archwyrm · · Score: 1

    So, I can use this to throw virtual chairs?

    --
    Fascism should more properly be called corporatism because it is the merger of state and corporate power. -- Mussolini
  30. Re:Not related to holography, at all. by Anonymous Coward · · Score: 0

    Agreed - I wish people (and especially Hollywood) would learn just what the hell a hologram IS.

  31. Worst Salad Bar Ever by Algae_94 · · Score: 1

    It's bad enough that some people only eat salads, but now virtual salads! I can just feel the weight melting off!

  32. Pepper's Ghosts by Anonymous Coward · · Score: 0

    Its another variation on Pepper's Ghosts and not a Hologram. But its cute I'll give this implementation that.

  33. Whats with the crappy resolutions? by Snaller · · Score: 1

    In this day and age, why do they always upload this in some shitty lowres version recorded on someones Nokia phone from 1998?

    1080p people!

    --
    If Google really cared they would fix Android Chrome to reflow text, instead of discriminating