Slashdot Mirror


Robot Swarm Control On Microsoft's Surface

zerOnIne writes "Dr. Mark Micire of UMass Lowell has built an intriguing new user interface on the Microsoft Surface, a multitouch-capable table computer. The interface is being used to control swarms of robots for disaster response, search, and rescue. One of the most interesting things about it is the intuitive tabletop joystick widget. Using a very fast hand-detection-and-identification algorithm, they can paint a touch joystick (dubbed the DREAM controller) directly underneath the hand. This joystick conforms to the size of the user's hand and tracks with hand movements, making sure that the control is always directly under the hand where the user expects it, even without haptic feedback. I've had a chance to go hands-on with this system, and I think it's truly remarkable."

12 of 106 comments (clear)

  1. Let me know when the price drops by IndustrialComplex · · Score: 3, Insightful

    Still somewhere over $5k?

    I'd love to build this into something... if I could sell it to someone other than businesses looking for a way to waste money.

    --
    Out of modpoints but really liked a post? 1BDkF6TtmmeZ3yqXbz9yhdYVqRYnwFoXDj
    1. Re:Let me know when the price drops by Anonymous Coward · · Score: 2, Insightful

      Surface uses infrared reflections to generate an image which is then processed. Alot of the challenge for a device of this type is the analysis of the IR, handling ambient light, and diffusion. If you were going to roll your own, I'd start with a project such as: http://digitalstratum.com/programming/ftir_build
      or a similar FTIR method. However, if you just want multitouch, then you've got other options such as project based (search for wii whiteboard).

      Surface provides a fairly substantial SDK with various multitouch controls, a simulator, and other such things. It also has a tag/barcode recognition system.

  2. Re:Unbelievable by cptdondo · · Score: 4, Insightful

    It's a very, very cool front end. Where does it get the data in the real world?

    I'm running a construction job with 3 contractors. Today they had 8 excavators, 3 backhoes, half-dozen off-road trucks, a water tanker, a vactor truck, and probably a few things I've forgotten. They were hammering up concrete, ripping down a building, tearing up a dam, and moving an incredible amount of dirt. They still managed to dump the dirt in the wrong place.

    A webcam http://www.ci.springfield.or.us/millrace/images/ww.jpg and a cell phone do more for me than this.

    Don't get me wrong, I think it's cool as hell, but GIGO applies to this in spades.

    I'd love to see a real application for this; not a simulation.

  3. VIRTUAL robot swarm control on MS surface by Michael+D+Kristopeit · · Score: 3, Insightful

    NOTICE: no robots swarms were actually controlled in the making of this story

  4. Re:RTS games? by Psaakyrn · · Score: 2, Insightful

    The whole point of this is to micromanage troops. Sure, you can control large numbers of units efficiently using that, but can you control a trio of SCVs to heal each other, another 4 to poke a group of irritating zergling, swap roles to make sure all of them receive no casualties, and initiate an SCV rush on a zerg base? (well, unless you're korean)

  5. Re:Whats the worst that could happen? by Ethanol-fueled · · Score: 3, Insightful

    It's nothing new. They've been facilitating botnets for at least a decade now.

  6. Re:Is it just me? by Anonymous Coward · · Score: 1, Insightful

    "swarm of robots" is frightening. There's a distinction.

    Not as frightening if you are sitting at the controls

  7. Mod This Shit Down by Anonymous Coward · · Score: 4, Insightful

    Yeah, I saw that episode of Saturday Night Live too. I laughed at it. I enjoyed it. With me so far?

    It aired April 8, 2000, more than ten years ago. It got old. You're not funny or clever. You're not some kind of deep, cultured, worldly guy. You're some dude on Slashdot who's repeating something from ten years ago that was amusing but not all that funny in the first place. It was a bit funny back when that ugly fuck Christopher Walken said it and it was a new skit. It's repetitive now.

    You might as well parrot another predictable, cookie-cutter, assembly-line Slashdot meme. The only difference is that it would be a Slashdot meme and not a pop culture meme. Nothin' personal. Just that Slashdot will be greatly improved when we stop celebrating this bullshit.

    1. Re:Mod This Shit Down by lgw · · Score: 3, Insightful

      You might as well parrot another predictable, cookie-cutter, assembly-line Slashdot meme. The only difference is that it would be a Slashdot meme and not a pop culture meme. Nothin' personal. Just that Slashdot will be greatly improved when we stop celebrating this bullshit.

      In Soviet Russia, cowbell needs more Natalie Portman!

      Yes, yes, memes are lame. You're not some kind of deep, cultured, worldly guy for pointing that out. Being lame is sort of the point of memes. We're a bunch of lame nerds sharing a silly, arbitrary common culture. Sorry, but it's what we do.

      Kirk would totally kick Worf's ass. Emacs > VI! Dr. Who is better than Star Wars or Trek! This is an ex-Parrot! Mandatory XKCD reference!

      Yeah, it's all lame repetition of old stuff, some of which wasn't even that great to begin with, but, hey, that's culture for you.

      --
      Socialism: a lie told by totalitarians and believed by fools.
  8. Re:Boooring by macshit · · Score: 5, Insightful

    "Surface" is yet another piece of slightly-interesting-in-theory-but-kind-of-meh-in-reality tech that microsoft has been trying to get people enthused about for ages -- and consistently failing. You know, kind of like tablet computers before Apple actually made people want them.

    I wouldn't be at all surprised if Apple suddenly teams up with Ikea and has every living room in the country computing with their coffee-table within 3 months though.

    --
    We live, as we dream -- alone....
  9. Re:RTS games? by icebike · · Score: 2, Insightful

    The problem with RTS games path finding vs robot path finding is that the games have a flawless description of the environment (the description IS the environment) and no inherent physical limitations on the driven device, only ones programmed in.

    Well, that and the utter LACK of any ACTUAL ROBOTS to guide. (Or those few that do exist are so damn expensive nobody can afford a swarm of three).

    Oh, and those Surface tables... Those aren't exactly laying around anywhere either.

    But overlooking that minor obstacle for the moment, the first thing that goes to hell when you actually NEED a robot swarm is that flawless environment description. And of course situations needing swarms never occur where you have maps, they happen annoyingly in some remote area, immediately adjacent to (but outside of) the area your funding covered.

    Perhaps thats why the summary is so ga-ga about the joy stick simulation, because its the only part of this that seems remotely usable on Joe SixPack's touch screen device.

    --
    Sig Battery depleted. Reverting to safe mode.
  10. Re:Is it just me? by Jane+Q.+Public · · Score: 2, Insightful

    Here's what I perceive to be a real problem: from what I could see in the video, using the "Dream Controller" requires the constant and complete use of both hands. That drastically reduces its usefulness in the real world. As long as you are using the Dream Controller, you can't do ANYTHING else. And that's just bad. At least with a traditional joystick, you can at least temporarily work most functions with one hand. With other kinds of physical controllers like the Cyberman II you can control 6 complete degrees of freedom with one hand, while you temporarily do something else with the other (which is normally used to press buttons).

    I'm just not impressed.