Slashdot Mirror
Robot Swarm Control On Microsoft's Surface
zerOnIne writes "Dr. Mark Micire of UMass Lowell has built an intriguing new user interface on the Microsoft Surface, a multitouch-capable table computer. The interface is being used to control swarms of robots for disaster response, search, and rescue. One of the most interesting things about it is the intuitive tabletop joystick widget. Using a very fast hand-detection-and-identification algorithm, they can paint a touch joystick (dubbed the DREAM controller) directly underneath the hand. This joystick conforms to the size of the user's hand and tracks with hand movements, making sure that the control is always directly under the hand where the user expects it, even without haptic feedback. I've had a chance to go hands-on with this system, and I think it's truly remarkable."
Isn't the "swarm of robots" aspect slightly more interesting than the "touchscreen interface" aspect?
... and then they built the supercollider.
We have done this with real robots also. See links in posts below. Basically, if you had the ability to geo-locate your vehicles (via cell phone gps for example) and had a camera that could watch them, then you would have the circles drawn around them just like in this video. The simulation is on a completely separate server and is modeled as if it is being viewed from an overhead camera. So, the simulation is just for the robots. All of the registration and camera modeling is done as if it is real.
We hope to be deploying this in the near future with real responders in the field.
Hope that helps.