Slashdot Mirror


A Look Beneath the 'Surface'

Hajsky writes "Ars Technica takes a closer look at Microsoft's new "Surface" tabletop device. Turns out that Surface isn't actually a touchscreen at all, but uses five cameras located in the table's base to record movement and touch. 'The five cameras are near-infrared devices, but that's not because they are trying to read heat signatures from fingertips (or other body parts) on the table. Instead, it's because the entire surface of Surface is bathed in light; by illuminating the top of the table, the cameras can easily see when things are placed on it. Shining colored light across the surface of the table would spoil the effect that Microsoft wants, so near-infrared light is used for invisible illumination.' The whole setup runs on a Core 2 Duo and off-the-shelf hardware, and can handle 52 simultaneous touches." jfanning wrote with a link to an overview of similar technology used in the Helsinki 'CityWall'. The article she provides discusses the unique public display, and has an in-depth video on the way these kinds of setups work.

15 of 177 comments (clear)

  1. D'oh by Swizec · · Score: 3, Interesting

    The video in yesterday's post DID say that the whole thing was run by five cameras. Doesn't it still make a touchscreen if stuff happens when you touch it? Why woudl it be any less of a touch screen if it sees you touchign it instead of feeling it?

  2. Jeff Han's work at NYU and Perspective Pixel by orospakr · · Score: 5, Informative

    Jeff Han lead project at NYU to produce multi-touch display technology and some demo applications.

    Take a look at the original work at NYU: http://cs.nyu.edu/~jhan/ftirtouch/

    And the spin-off company by the same guys to develop the technology: http://www.perspectivepixel.com/

    Very cool stuff. If you look closely, you can tell that they're running it on GNU/Linux.

    Hopefully, they'll chose to collaborate with the X and kernel guys to create proper generic interfaces for multi-touch pointing device input.

  3. DIY Multi Touch by Picass0 · · Score: 5, Informative

    http://tinker.it/now/2007/02/28/multitouch-table-e xperiment/

            * 1 panel of plexiglass 8mm thickness
            * 2 strips of IR LEDs (18 LED per strip)
            * 2 sheets of tracing paper
            * 1 projector
            * 1 mirror
            * 1 analog camera sensitive to IR light
            * 1 IR filter for the camera
            * 1 computer

    The traking was done using vvvv. http://vvvv.org/tiki-index.php

    ==============

    Also See:
    http://www.engadget.com/2007/03/01/build-your-own- multi-touch-table/
    http://www.slashgear.com/make-your-own-multitouch- projected-table-284137.php

  4. The frustrations of parallax by G4from128k · · Score: 4, Interesting

    I can't help but wonder how they will compensate for parallax between users' eyes, fingertips, and the screen objects. I'd imagine that the display panel will be relatively thick for structural reasons and that most users will be sitting far off the central axis of the table (i.e., the coffee-table scenario). This means that the image on the screen will be displaced with respect to the line sight from eyeball to fingertip. Moreover different people sitting around the table will see different parallax displacements between fingertips and the screen. Without some compensation for this, the device will be frustrating to use because it won't be intuitive as to where to touch the table top to "touch" an underlying display object. People will often touch the screen where they think they should only to find they've grabbed the object next to the one they really wanted.

    P.S. Acrylic is a horrible choice of material for the top as it scratches too easily.

    --
    Two wrongs don't make a right, but three lefts do.
  5. Gorilla arm by $RANDOMLUSER · · Score: 4, Interesting

    Does anybody remember the HP touchscreen computer (from back in the Lisa days) which bombed miserably because people couldn't hold their arms up for hours on end? The thing about a mouse or trackball is that a little motion produces a lot of motion of the cursor - without fatigue.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  6. That's not the principle of a camera by Nymz · · Score: 5, Funny

    A camera doesn't just detect touch, it can detect movement, objects, people, etc. For example, if you where in a conference room, and someone lifted a chair to throw, then the cameras could identify the object being thrown, who is throwing it, and whom it was aimed at, and then play the appropriate sound file DUCK.wav!!!

  7. Gaming? by Shadow+Wrought · · Score: 4, Interesting

    Could this be a forerunner of a gaming tabletop? All the terrain, units and record keeping are kept for you as you play on a largish surface. Could be pretty cool.

    --
    If brevity is the soul of wit, then how does one explain Twitter?
    1. Re:Gaming? by nightwing2000 · · Score: 3, Interesting
      The full-desk display would be neat - but the obvious question is - what's the resolution?

      This thing is just a projection unit, which means underneath is bulky and blocked off. It doesn't seem to be the real table-top display we're all looking for, where you can pop up a window and read it about the same size and resolution as a piece of paper. Basically it should be an electronic D-paper. I think I'll wait.

      So, the big deal is the interface. This sounds too complicated. Each special item has to have its own handler - cameras, fingers, stylus, phone, PDA, etc. A "general environment" that has too be programmed for each special case doesn't sound that great.

  8. Re:touches by Kamineko · · Score: 3, Funny
  9. Re:can handle 52 simultaneous touches by Curate · · Score: 3, Funny
    So how exactly does one simulate 52 simultaneous touches?


    Drop a pack of playing cards on it?

  10. Re:Disappointing by drinkypoo · · Score: 4, Informative

    For instance, from what I understand (though I may very well be mistaken), the table can read various things on it. That's great, but your body (or any part of it) better not be obscuring the infrared bath, otherwise it will look like your arm also is supposed to be indexed on it.

    The cameras and the IR light source are all inside of the table. You can see this from the diagrams. Nice try though.

    Also, the whole multitouch thing seems a bit overrated. Now, before anyone jumps on my back, I understand its implications

    If you understood the implications at all you would see that there are benefits for collaborative computing. Have you ever sat around a table (implying the involvement of others) with a pile of photos? Without multitouch you can't pull off the same level of interactivity with a computer screen.

    Not only that, but the damned thing isn't all that new.

    Yes yes, there are fairly ancient examples of similar interfaces - but none of them have made it to the home or even business market, so this is an utterly irrelevant datum.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  11. Applications for the Table by deleo77 · · Score: 3, Interesting

    The more I think about it, this table (or whatever they end up calling it) could be the computing device that finally succeeds in finding its way into peoples' living rooms. People don't want to compute off of their TV, they only want their TV to display things, that's why every attempt to combine the internet with a TV has pretty much failed. But imagine this device somehow integrated into your coffee table and using it to order and pay for a pizza, using it to control your home lighting and thermostat, using it to look at photos, magazines, catalogues, pay your bills, or using it to sort through your home media library of music and movies. The list goes on and on. The technology will have to get better, the cost will have to come down, it will have to be simple to use, and the applications will have to be developed flawlessly, but I actually think Microsoft could pull it off. If Apple created this people would be gushing over it because they would know that Apple would succeed in doing all of the above. Microsoft should pour a lot of money and resources into this, because they might be on to something big. I hope they pull it off; there isn't enough innovation out there these days, too many copy cat devices. It's time for something new and this could be it.

    1. Re:Applications for the Table by Irish_Samurai · · Score: 5, Interesting
      Man, I can think of a ton of things that I could write myself using XNA.

      • Specialized drink glass code that you could play drinking games with (russian roulette comes to mind)
      • Almost every board game ever made
      • Air Hockey
      • A MTG interface
      • If there was a way to start manufacturing items, or self encoding, with the domino encoding on them, writing an app that queries wikipedia when the item is placed on it to give you a neato little "Identify" effect
      • Take the same idea as above, but it allows you to purchase said item directly from the vendor by tapping you credit card on the table. Cool if you have people visiting or if you are at someone elses house.
      • Another layer of immersion with certain types of digital media (travel shows can display interactive maps without using up viewing real estate, ect...)
      • Multi user story telling - Essentially choose your own adventure where everyone was a character and chose from a list of actions to dynamically create a story or show.
      • Virtual turntables
      • A real time map of my house with live feeds from webcams actually playing in the roomspace
      • A tool that allows you to generate custom tabletop game boards and rule structures on the fly. Lego men now have another use!
      • A visual warehouse management tool
      • Virtual home decorating swatches (although the screen and projection tech may need to catch up on that one)


      I could go on and on. None of this is really mindblowing, but there could be a very decent cottage industry popping up around this one item alone.
  12. Projector. by pavon · · Score: 3, Informative

    The article mentioned that the device uses a rear projector for the screen, so they could easily have the scattering surface (what the image is projected onto) be the topmost layer (or beneath a very thin protective layer), resting on top of the thick structural portion (transparent glass or plastic).

  13. Re:Power cords? by pdbaby · · Score: 4, Funny

    Your carpet becomes the power cord.

    Oh, great. So my carpet becomes the power cord and my coffee spill now becomes my death.

    --
    Global symbol "$deity" requires explicit package name at line 2. - If only $scripture started "use strict;"