Slashdot Mirror


CMU Researchers Create Multitouch Surface Anywhere

tekgoblin writes "In a joint effort between Microsoft and the Carnegie Mellon Human Computer Interaction Institute, a new interface has been born. The new interface is usable on any surface, including notebooks, tables, walls and body parts. The UI is completely multitouch and worn on the shoulder, which will turn any surface you are pointing at into a usable workspace by the combination of a projector and a 3D modeling device similar to the Kinect."

53 of 81 comments (clear)

  1. hm... by Lockyy · · Score: 5, Informative

    I'm pretty sure I saw this absolutely ages ago. It was an open source project so you could do it yourself and it was just a projector and a camera on a thing around your neck. The video had them playing a racing game on a piece of paper, they turned the car by tilting the paper. In fact, I'm going to find an article. http://www.wired.com/epicenter/2009/02/ted-digital-six/ There, already done by MIT.

    1. Re:hm... by Anonymous Coward · · Score: 1

      This is completely different. You wear it on your shoulder - NOT around your neck. And you no longer need to wear colored caps on your finger tips.

    2. Re:hm... by Lockyy · · Score: 2

      Changing the location of the camera doesn't exactly make it completely different .The lack of a need for finger caps is nice, but that purely means it's a refinement of an existing piece of technology. The slashdot summary just made it out like a completely new idea when it's already been done. I admit, it's a great piece of tech and a much needed advancement from what was done at MIT but it's not a new interface being born.

    3. Re:hm... by neokushan · · Score: 2

      And I'm pretty sure when apple releases a similar device in a few years time, people will think they invented it, too.

      --
      +1 IDisagreeSoHeMustBeATrollOrAnAstroturferOrAShill
    4. Re:hm... by dotancohen · · Score: 1

      And I'm pretty sure when apple releases a similar device in a few years time, people will think they invented it, too.

      Why not, the MS fanbois did too:
      http://what-is-what.com/what_is/microsoft_surface.html

      The problem is that MS gives it's products very generic names (Office, Media Player) and therefore hijacks the terms. How many people know that _other_ office suits even exist? Surface, isn't that a Microsoft innovation?

      --
      It is dangerous to be right when the government is wrong.
    5. Re:hm... by neokushan · · Score: 1

      The point I was trying to make (possibly rather poorly) was that whomever invented it tends to get overshadowed by whomever makes it popular

      --
      +1 IDisagreeSoHeMustBeATrollOrAnAstroturferOrAShill
    6. Re:hm... by Lockyy · · Score: 1

      I was unaware of this, I didn't follow it up after reading about it back in '10 and thought they'd done it way before I found out about it. Very disappointing. Maybe they got picked up by Microsoft?

    7. Re:hm... by LucidBeast · · Score: 1

      I saw something like this from Nokias research guys last fall in Amsterdam Symbian conference. They didn't have it mounted on the shoulder predator style and it was running on a Symbian phone so I guess it's not as cool... Can't find a link for it...

    8. Re:hm... by countertrolling · · Score: 1

      ...people will think they invented it, too.

      Perfect opportunity to sue Samsung when they release it.

      Ob-la-di, ob-la-da, life goes on...

      --
      For justice, we must go to Don Corleone
    9. Re:hm... by dotancohen · · Score: 1

      Yes, I was corroborating your observation!

      --
      It is dangerous to be right when the government is wrong.
    10. Re:hm... by zippthorne · · Score: 2

      I got one of my relatives an iPad, and while she was showing it off to her friends, the Microsoft surface came up, so I had them watch the youtube parody using the iPad

      They thought the table was a great idea. Despite watching an unflattering parody video about it, on a device that already has a fairly large screen and a multi-touch interface and which fits in a backpack.

      --
      Can you be Even More Awesome?!
    11. Re:hm... by mjr167 · · Score: 1

      They also did it with Wii-motes.

    12. Re:hm... by GameboyRMH · · Score: 1

      Lemme guess, you're a patent examiner?

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    13. Re:hm... by Eponymous+Hero · · Score: 1

      it's going to be called the iSuck

      --
      insensitive clod overlords obligatory xkcd car analogy russian reversals whoosh pedant fanbois ftfy in 3...2...1..PROFIT
    14. Re:hm... by nomel · · Score: 1

      The colored finger tip caps let you do something that's computationally simple, like blob detection....so, they were more of an indicator of non-programmable gpus and relatively slow cpus at the time. You pretty much need a programmable gpu to do it real-time without blobs, and those only partially existed, using shader language hacks, before the modern video cards that support CUDA and openCL.

  2. Now this IS augmented reality by Hentes · · Score: 1

    After all those GPS-tagging and 2D barcodes there finally is an AR idea that's actually useful. If they could design this into a convenient headgear that would be awesome.

    1. Re:Now this IS augmented reality by jhoegl · · Score: 1

      I was actually envisioning the Sci-Fi stuff where soldiers have camera type devices on their shoulders, on top of their armor.

      You know what is the potential cooler part of this? Successful implementation for the blind.

  3. Hah by X.25 · · Score: 2

    Now we just have to wait for Apple to patent the concept of using this on a rectangular surface with rounded edges.

    And in courts, whoever owns this technological patent would probably lose, while whoever patented a design that uses this invention would win.

    I am getting lost.

    1. Re:Hah by dotancohen · · Score: 1

      Now we just have to wait for Apple to patent the concept of using this on a rectangular surface with rounded edges.

      http://www.dilbert.com/strips/comic/2011-10-18/

      --
      It is dangerous to be right when the government is wrong.
  4. Reminds me of sometihng... by doohan · · Score: 2

    Ahh, so the Predator was just looking for a good surface to use for multitouch all along. Poor misunderstood Predator.

  5. Porn! by Anonymous Coward · · Score: 1

    I'm gonna turn every person i meet into a live3d interactive porn display surface!

    Only viewable with the goggles... That finally do something.

  6. Bring your own surface? by captainpanic · · Score: 2

    I can see this having many cool applications (if only because it has a very good built in camera system, and a projector).

    But I cannot see myself on a train, working for an hour literally on the back of my hand. I would probably still want a flat, white, sturdy surface to work on.
    And... isn't a keyboard + mouse a million times cheaper than a projector + motion detection?

    1. Re:Bring your own surface? by dotancohen · · Score: 1

      But I cannot see myself on a train, working for an hour literally on the back of my hand. I would probably still want a flat, white, sturdy surface to work on.

      You see, that would be the back of _my_ hand!

      --
      It is dangerous to be right when the government is wrong.
    2. Re:Bring your own surface? by gl4ss · · Score: 2

      they see projector and motion detection being cheaper - as in less plastic - in the long run.

      real problem is that it doesn't really make the computer output any better from the individual. like the minority report ui. sure it would be nice to watch some hot babe use it.. but it's an awful, awful ui for doing the work.

      next up: crayons and cubicle walls are the new excel.

      --
      world was created 5 seconds before this post as it is.
    3. Re:Bring your own surface? by angel'o'sphere · · Score: 1, Interesting

      real problem is that it doesn't really make the computer output any better from the individual. like the minority report ui. sure it would be nice to watch some hot babe use it.. but it's an awful, awful ui for doing the work.

      You say that based on what experiece?
      I'm working in a "data center" right now.
      Most people here have a desk that can be "lifted" so you can work with your computer while standing. Everyone has 2 or more screens.
      Everyone is more or less working on the production environment, the prelife/preproduction environment and the UAT environment.
      Besides the actuall doing, which is ofc done basically in bash, we use dozens of monitoring tools.
      If you ever had seen a battlefield simulation or operation controllers using modern disaster survilance systems you would talk different ;D

      I can immagine lots of usefull interactions and visualizations in software development ...

      Sure, an office worker typing leters might not need it.

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    4. Re:Bring your own surface? by hajile · · Score: 1

      The best things in life are already multi-touch. *winks*

  7. Rule 34 by TaoPhoenix · · Score: 1

    Here for the "any surface you are pointing at" comments.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  8. Re:Bulky by jhoegl · · Score: 1

    It is a PoC, Proof of Concept.

    It seems MS stumbled on the next gen tech with their Kinect device and freelance modding to show what it is capable of.

    It also shows that innovation is still out there, but who has benefited from this? Corporations or the modders?

  9. Meanwhile, elsewhere in Microsoft by Sockatume · · Score: 1

    Microsoft's page about this project also discusses "Pocket Touch", a capacitive touch panel's that's designed to work through clothing. The idea is that you could have a touch panel on the back of your phone (or whatever) that could respond to gestures while it's still in your pocket.

    --
    No kidding!!! What do you say at this point?
  10. Using a variation of this technology... by Genda · · Score: 1

    I would love to see a wrap around work surface, that rolls up at the back and is translucent. A series of projectors below, project images onto the bottom of the work space. A camera above watches your hands. On the great big beautiful work surface, everything is multi-touch sensitive. Everything is accessible and can be managed by a wide selection of interactive models (everything from 3D mind-maps to a typical business desktop, and a hundred other working interfaces.) In fact depending on the task at hand, you can choose completely different working surfaces. Editing a movie, composing music, painting, writing the great American novel or 3D modeling whatever you want, the environment can be configured to fully support that task or activity. You can have your favorite surfaces saved and easily accessible. Combine this with a Seri-like speech cognition engine. Make the surface acoustically transparent and place a small array of speakers behind the projectors so an apparent sound image can move around with whatever is being projected.

    Such a system would transform creativity. Literally unleash invention. When the machine becomes a simple tool, that you can talk to, and that reflects what you can you can dream of by simply moving your hands and fingers. Imagine what you could create with such a machine? The mind boggles.

  11. Obsession with touch screens by Dunbal · · Score: 2

    Yes, I want to trade in my 2000 dpi mouse for my clunky index finger that probably shakes more than the entire traverse of my mouse every time my heart beats. Please.

    --
    Seven puppies were harmed during the making of this post.
  12. Consideration about Asus/Microsoft sensor by meliortony · · Score: 1

    I don't understand why you have to use a sensor for gesture recognition to re-invent the touch screen (I suggest this link where you can find a lot of opensource applications http://arena.openni.org/). Maybe it is time to re-think the concept of human-computer interaction considering the idea of using gesture to control an electronic device.

  13. Re:Bulky by xTantrum · · Score: 1

    god yes and geeky. It's like a retainer for your shoulders.

    --
    $action = empty(PHP) ? backToC() : unset(PHP) ; "when the concrete cases are understood, the abstractions are readily
  14. OmniTouch? by srussia · · Score: 1

    I thought a multi-touch device sitting on your shoulder would be called Polly-Touch!

    --
    Set your phasers on "funky"!
    1. Re:OmniTouch? by KlaymenDK · · Score: 1

      That is in all honesty a very good name for a shoulder-mounted gadget such as this. :-)

    2. Re:OmniTouch? by MrBandersnatch · · Score: 1

      I must admit I love the term *grin*

    3. Re:OmniTouch? by Anomalyst · · Score: 1

      Pieces of Windows 8!
      Polly wants a tracker! AWK (or do you prefer PERL?)!

      --
      There is no right to feel safe thru security vaudeville at the expense of everyone's freedom, privacy and tax money.
  15. Re:Not new, MIT did this long time ago by miknix · · Score: 3, Informative

    http://www.pranavmistry.com/projects/sixthsense/

    'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

    There was also a TED talk about it. If you haven't seen it yet, you should, it is very inspiring and futuristic.

    So yeah, another slow news day?

  16. If this is to take off- by Zaldarr · · Score: 1

    The real question remains- can it be used for porn? Bam. Millions of sales... and the world grows slightly sadder.

    --
    I write professional videogame reviews! http://www.digitallydownloaded.net/
  17. Finding the "G Spot" by retroworks · · Score: 1

    The application to body parts raises sensitive questions.

    --
    Gently reply
  18. Prior Art by necro81 · · Score: 1

    Pranav Mistry at MIT Media Lab demonstrated something similar at a TED talk in 2009. His was slung about the neck. He and his advisor, Pattie Maes, called it Sixth Sense.

  19. Yawn... by ghetto2ivy · · Score: 1

    I'll wait till the version with 3 dots and the little missiles comes out.

  20. This is perfect... by aurb · · Score: 1

    ... for those who like to touch themselves!

  21. Re:Oh where is Steve Jobs? :( by cavreader · · Score: 1

    Yeah they really dropped the ball with Kinect. Hardly anybody wants to use that.

  22. Shoulder-mounted projector? by Guppy · · Score: 1

    The UI is completely multitouch and worn on the shoulder, which will turn any surface you are pointing at into a usable workspace by the combination of a projector and a 3D modeling device similar to the Kinect.

    Please let me set the default cursor to three little red dots.

  23. Avoid those lawsuits by horza · · Score: 1

    All well and good, but just don't try pointing at any surface that might happen to be black with rounded corners.

    Phillip.

  24. gestures by xyourfacekillerx · · Score: 1

    too bad they don't own patents on what will likely become common gestures.

  25. Re:Bulky by justforgetme · · Score: 1

    It is a Proof of Concept.

    I thought it was the Shoulder Cannon of the Predator

    --
    -- no sig today
  26. I'm working on something similar... by MrBandersnatch · · Score: 2

    for my masters, but sadly without the advantages of having access to a custom PrimeSense camera (I had initially looked at the kinect but the 50cm minimum range makes things rather awkward). Lordy, I'm almost embarrassed at how primitive what I'm working on is in comparison to this piece of work (in my defence though, part-time, unfunded student, and its a HCI rather than comp-sci oriented masters).

    This is fantastic stuff since THE primary problem I'm seeing in creating any usable interaction from Wearable Gestural Interfaces such as this is in getting accurate and reliable computer vision techniques working to detect finger/hand positioning. Time of flight cameras solve this of course and shoulder mounting, although it looks strange, is actually a very good use of the body for placement since its an area that is seldom obstructed and relatively safe from being knocked when moving around. Personally, where I see this evolving is so that devices such as these end up being similar to large closed-cup headphones that you wear around your neck - does saying that make the concept prior art? *grin*

    So I guess I'd better ensure this one makes it into my lit review...luckily I'm looking at something slightly different since my focus is primarily on the use of in air gestures for command and control and the projector is really secondary....but damn it would have been nice to have access to some of the underlying depth sensing tech.

    Oh http://os6sense.blogspot.com/ if anyone is interested

  27. Projected from... by eegad · · Score: 1

    a little lens, maybe mounted over one of my eyes. And if that lens also shot red laser beams well then I think we'd have a product.

  28. I've seen similar things at SIGGRAPH by peter303 · · Score: 1

    It was a virtual keyboard on any surface implemented by lasers. This could be readily generalized to multi-touch I presume.

    This opens the possibility of much smaller mobile computing devices if you dont need a physical screen, but just a laser port or two. That could fit in a ring, watch, keychain, etc.

  29. Re:Oh where is Steve Jobs? :( by CSHARP123 · · Score: 1

    He is Dead. Didn't you read the news? Where you've been? Living under the rocks.

  30. Body parts? by bwcbwc · · Score: 1

    I see a great future for this technology in the porn industry and in strip clubs.

    --
    We are the 198 proof..