Slashdot Mirror
Microsoft Research Shows Off Multi-Touch Mouse Prototypes
Engadget has snagged some of the details behind a bunch of multi-touch mouse prototypes from Microsoft Research. The prototypes range from the wacky to the extreme, but at least they are thinking outside the mouse trap. "Each one uses a different touch detection method, and at first glance all five seem to fly in the face of regular ergonomics. The craziest two are probably "Arty," which has two articulated arms to cradle your thumb and index finger, with each pad housing its own optical sensor for mission-critical pinching gestures, and "Side Mouse" which is button free and actually detects finger touches in the table immediately in front of the palm rest. Of course, there's plenty of crazy in the FTIR, Orb Mouse and Cap Mouse (pictured), which rely on an internal camera, orb-housed IR camera and capacitive detection, respectively. Of course, there's no word on when these might actually see the light of day"
The game they demo the second mouse with in the video appears to be cube. I suppose they used it because they had access to the source code and could modify it for multitouch interaction.
Frankly multi-touch is really needed to help modernize the mouse. As somebody who uses a Macbook Pro at work I can honestly say it is the first trackpad I have ever used that doesn't make me not long for a mouse. In fact I would say with the exception of gaming I actually prefer the trackpad and its many gestures. The amount of things that can be done is both more intuitive and more elegant than simply strapping more buttons on a mouse. Now obviously multi-touch only works well if its implementation is great, so only time will tell. Thankfully it seems many companies are involved in this effort, so we don't have to only rely on MS "innovation"
Personally, I hold the mouse with my thumb and ring-finger on the sides with my index and middle fingers resting on the buttons. When I'm at home using my Microsoft Intellimouse Optical (not explorer), I use the same grip except that I use the top joint of my thumb to hold the mouse so I twitch the tip of my thumb to hit button 4. (http://www.actionforblindpeople.org.uk/data/images/width590/hand-on-mouse-514.jpg)
I move the mouse with a combination of movements including the use of my ring-finger (holding onto the mouse), my thumb (holding onto the mouse), and, to a lesser extent, my wrist which rests on a gel pad.
Why? Because my fingers are much more dexterous than my wrist and thus it's better for moving around multiple links, playing an FPS, or doing any kind of visual editing.
And yet... they seem to think I want a touchpad on a bump.
Modernize the mouse maybe - but what about our hands? Every single one of those looked like a carpal tunnel nightmare.
L'esperienza de questa dolce vita (The experience of this sweet life) - Dante Alighieri, The Divine Comedy
I'm not sure a mouse needs to be "multi-touch", in the same way that I don't think a mouse should respond to voice commands (sorry, Cmdr. Scott....).
Multi-touch makes sense for touch screens or track pads, as it changes them from a "cave-man" interface where the only real choices you have is "grunt" (tap), "grunt-grunt" (double-tap), and "uuuuuuugh!" (drag), into an interface where you have a few more choices (multi-finger drag, pinch, etc.).
The mouse already underwent such a change, when multiple buttons were added. I don't know if trying to map things you do on a flat panel onto things you do to a mouse makes any more sense than trying to make a joystick "multi-touch".
What is wrong with different interfaces having different semantics? I don't expect to drive my car with a touchpad, use a mouse to control my stove, or do word-processing with a steering wheel.
www.eFax.com are spammers
Well change seems inevitable because developers want the same multi-touch apps for all the new phones to work on desktops without redoing the interface. So the PC is going to need multitouch. So either the screen goes multitouch (which it has in some cases), or the input devices do. Since touchscreens have issues with things like smearing and comfort distance, that leaves the interface devices. Multitouch pads have been done, but most people still prefer mice. They're more precise due to the size of the working area, and easier for certain tasks like dragging because of the extra degrees of freedom on the arm/elbow which frees up the fingers for clicking instead of overloading them for both position and input.
Of these candidates, the cap mouse is most likely to win out, followed by the orb mouse, which may see a competing run in the high end. Why? Let's see:
FTIR mouse: This is basically an internal reflecting material like a lightpipe or fiberoptic cable. The problem is it limits the mouse because it requires this kind of material (think the demo uses acrylic), and design such that the camera can always see it. The shape has poor balance, CG, and drag properties, and will probably result in breaking or issues sliding for many people. The restrictions to mouse design will annoy existing manufacturers, unlike say optical sensors, which were just drop in replacements for mouse balls.
Articulated mouse (Arty): Not happening, for a simple reason - people won't want to readjust to left/right click being thumb/forefinger instead of index/middle. It sounds stupid, but believe me it will be a showstopper. Plus the design is a bit fragile, and I'm not sure on the ergonomics of having to extend the finger and thumb like that, seems like an RSI issue waiting to happen.
Side mouse: This has some potential, but it will be plagued by unintentional inputs. Any time you drum your fingers impatiently, drop a pen on the desk, move the camera too close to something sitting on the desk, it will go nuts. It might be useful in cases where you can't build a touchpad into a device, but in most of those cases the device is so small you want to hold it not rest it on a desk anyway, so there'd be no surface for the side mouse to track on.
Now for the showdown between the two serious contenders.
Orb mouse: Really nice input image. Can easily do a variety of applications with it, since there's so much area. Datacenters sometimes use illuminated vein pattern recognition for biometrics, which can be efficiently integrated with this, and it's a better solution than those stupid touchpad fingerprint readers. But for more conventional apps it's got the most area, the best shape to exploit the use of all fingers, and in deference to the mention of clock-based positioning on the Gizmodo article about it, will probably be the easiest for people to extend thinking to. The main showstoppers are cost (not sure) and bulk/shape issues. People may not find the bulgy shape appealing though I suspect it will test well with male audiences.
Cap mouse: Probably going to win, despite the low resolution sensor image. Why? That "$1 gesture recognition" on the video says it all. Not the gesture support part, the $1 part. Cost wise it's probably cheapest, and it seemed to work sufficient for the apps in the demo. It's also just a bolt-on to existing mouse designs. No need to modify the existing shape or ergonomics to accommodate it, which means it's the path of least resistance. If it's also the path of least cost, which given most of the rest need a camera-quality sensor it most likely is, then the winner seems pretty obvious.
Introducing the new Occam Fusion! Now with sqrt(-1) fewer blades!
An ergonomist taught me that one thing you do not want to do is continually hold your button clicking fingers away from the buttons. That kind of static loading on the extensor muscles is really bad. While using a mouse and are not actively clicking, you want the fingers to rest on the buttons without extensor or flexor muscles being used (preferably with an armrest supporting your entire forearm). With these touch sensitive devices you HAVE to use the extensor muscles to keep the fingers away from the device.
I think for Desktops the design that will win out is keyboards with trackpads, like a laptop keyboard separated from a laptop. Most people would simply use those alone, gamers or people with more need for fine control would attach a traditional mouse for specific uses.
But fewer and fewer people will be using them, since laptop use is dramatically increasing.
Perhaps mice will even go away altogether, replaced by more task specific controls, like game controllers and Wacom tablets for artists.
"There is more worth loving than we have strength to love." - Brian Jay Stanley