Slashdot Mirror
Microsoft Says Goodbye GUI, Hello MUI
theodp writes "On New Year's Eve, the USPTO revealed that Microsoft is seeking patents for controlling a computer by simply flexing a muscle. Microsoft proposes using Electromyography (EMG) sensors and a wired or wireless human-computer interface to interact with computing systems and attached devices via electrical signals generated by specific movement of the user's muscles. 'It is important to consider mechanisms for acquiring human input that may not necessarily require direct manipulation of a physical implement,' explained the inventors. 'For example, drivers attempting to query their vehicle navigation systems may find it advantageous to be able to do so without removing their hands from the steering wheel, and a person in a meeting may want to unobtrusively communicate with someone outside. Also, since physical computer input devices have been shown to be prone to collecting microbial contamination in sterile environments, techniques that alleviate the need for these implements could be useful in surgical and clean room settings.'"
So blind people will be able to use this MUI (since their muscles work)? How does it relay things back via muscles? Oh wait, you mean it's still a GUI? After all, even a keyboard-controlled graphical UI is still a GUI, not a KUI. FFS.
...but probably terrible in implementation.
Calibration for each individual person's body type? Tech support that involves actual physical human contact? (shudder) Epileptics would lose all of their work with regularity.
In my mind, this is one of those things where we've already made the intuitive leap to an input that makes sense and now people want to go back and think of something that takes more effort to replicate what we've already done in a more convoluted way.
Many years ago, at a RobotFest in Austin TX, I watched a dancer demonstrate triggering of multiple MIDI-controlled musical instruments from EMG sensors.
He danced, and the instruments played NON-preprogrammed accompaniment to his dance. If you watched CAREFULLY, you could see which muscle movements were triggering which sounds.
And he was GOOD. He'd obviously spent a LOT of years learning dance, and he'd obviously spent quite a bit of time mastering his new instruments.
As an AC says below : there are already medical applications for computer-processed muscle signals for prosthetics. I wouldn't like to see Microsoft act as a gatekeeper there, especially as they aren't even responsible for the founding research.
Prior Art?
:T:R:A:N:S:
Microsoft had been hit by hardware bugs (faulty hardware, pentium bug, etc), software bugs (don't know from where to start) and they are ensuring now they will be hit by bugs by the old definition. A simple fly could force you to move a lot of muscles, and your corporate database will be gone.
And could be far worse. You face some critical app, you know that you should not even think on moving that muscle and, of course, you will..
And will be interesting to see what happens with people that can't move certain muscles or do some combos, like i.e. doing the vulcan greeting, or closing just one eye... the new generation of computer disabled people is in the making.
Despite the examples given in the parent, I can't honestly think of a single practical use for an input device like this (as has been mentioned, Microsoft has a really warped idea of what qualifies as a "GUI"). I mean what would you use it for? A mouse may not be the perfect hardware for controlling your virtual world, but it's amazingly versatile. You can also let go of a mouse. I can just imagine a surgeon using this and then having to sneeze, or playing WoW with your new MUI device getting killed because you had to scratch your nose during combat. Driving?! Are they insane?? If you're not moving your hands from the wheel, what part of you IS moving?! I don't often flex my muscles while driving as that can often lead to involuntary sudden deceleration.