Slashdot Mirror
Microsoft Says Goodbye GUI, Hello MUI
theodp writes "On New Year's Eve, the USPTO revealed that Microsoft is seeking patents for controlling a computer by simply flexing a muscle. Microsoft proposes using Electromyography (EMG) sensors and a wired or wireless human-computer interface to interact with computing systems and attached devices via electrical signals generated by specific movement of the user's muscles. 'It is important to consider mechanisms for acquiring human input that may not necessarily require direct manipulation of a physical implement,' explained the inventors. 'For example, drivers attempting to query their vehicle navigation systems may find it advantageous to be able to do so without removing their hands from the steering wheel, and a person in a meeting may want to unobtrusively communicate with someone outside. Also, since physical computer input devices have been shown to be prone to collecting microbial contamination in sterile environments, techniques that alleviate the need for these implements could be useful in surgical and clean room settings.'"
It's the sound of all the slashdotters coming on the idea of not having to use a mouse when porn surfing. Just move your, eh, muscle to the direction.
So blind people will be able to use this MUI (since their muscles work)? How does it relay things back via muscles? Oh wait, you mean it's still a GUI? After all, even a keyboard-controlled graphical UI is still a GUI, not a KUI. FFS.
Anyone remember Q-branches invention of wrist muscle triggered darts? There has to have been loads of similar devices in science fiction! Just goes to show 90% of patents should never be approved.
Linux Admin: Does Joe seem even more retarded to you lately? ...
Windows Admin: I told him not to install Service Pack 2
Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
...but probably terrible in implementation.
Calibration for each individual person's body type? Tech support that involves actual physical human contact? (shudder) Epileptics would lose all of their work with regularity.
In my mind, this is one of those things where we've already made the intuitive leap to an input that makes sense and now people want to go back and think of something that takes more effort to replicate what we've already done in a more convoluted way.
Many years ago, at a RobotFest in Austin TX, I watched a dancer demonstrate triggering of multiple MIDI-controlled musical instruments from EMG sensors.
He danced, and the instruments played NON-preprogrammed accompaniment to his dance. If you watched CAREFULLY, you could see which muscle movements were triggering which sounds.
And he was GOOD. He'd obviously spent a LOT of years learning dance, and he'd obviously spent quite a bit of time mastering his new instruments.
As an AC says below : there are already medical applications for computer-processed muscle signals for prosthetics. I wouldn't like to see Microsoft act as a gatekeeper there, especially as they aren't even responsible for the founding research.
Prior Art?
:T:R:A:N:S:
Microsoft had been hit by hardware bugs (faulty hardware, pentium bug, etc), software bugs (don't know from where to start) and they are ensuring now they will be hit by bugs by the old definition. A simple fly could force you to move a lot of muscles, and your corporate database will be gone.
And could be far worse. You face some critical app, you know that you should not even think on moving that muscle and, of course, you will..
And will be interesting to see what happens with people that can't move certain muscles or do some combos, like i.e. doing the vulcan greeting, or closing just one eye... the new generation of computer disabled people is in the making.
Well considering the fact that MSFT spends over 5 billion a year on R&D, with very little to show for it in the way of actual products hitting shelves, it would be nice if they actually had something to show for all that cash spent.
I mean I can understand completely why MSFT shareholders aren't too happy with them right now. All that cash blown and the stock has pretty much been flatline for the better part of a decade while Apple and Google exploded. The last thing I remember coming out of MSFT R&D was that PC table (surface I believe its called) and I know it reminds me of something...hmmm....where did I see an idea like that? Oh yeah a Disney movie from 26 years ago.
Seriously, with 5 billion in cash a year, that's the best they can do? A PC table and a way to control your OnStar by flexing your wrists? At least if it has a medical use they can get something for it, but I doubt it will even make back 1/100th of what they've blown in R&D this year alone.
ACs don't waste your time replying, your posts are never seen by me.
I remembered that most of the new work on prosthetic arms these days focuses on using EMG to drive the arm behaviour (including Dean Kamen's new bionic arm), and there's a bunch of stuff done (and papers released) with driving the mouse for people with disabilities.
Surely this patent application has to be thrown out, and isn't Microsoft just wasting the Patent Office (and our) time with applications that are so easily shown to have been demonstrated before?
Look Ma, No Pen! Electrical Impulses Can Reproduce Handwriting
SmartHand: Merging Mind and Machine
Application of facial electromyography in computer mouse access for people with disabilities
Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces
Electromyography sensor based control for a hand exoskeleton
What's the original part here? The patent application does not specify any specific software application (just talks about interpreting the signals), so all the prior art should hold.
Now I imagine a new movie, where Arnold Schwarzenegger defeats the BSOD by the might of his muscles alone. (Of course, it may not work as well now, since he's the flabby Governator.)
Does it make you happy you're so strange?
...Muscle of Love
Despite the examples given in the parent, I can't honestly think of a single practical use for an input device like this (as has been mentioned, Microsoft has a really warped idea of what qualifies as a "GUI"). I mean what would you use it for? A mouse may not be the perfect hardware for controlling your virtual world, but it's amazingly versatile. You can also let go of a mouse. I can just imagine a surgeon using this and then having to sneeze, or playing WoW with your new MUI device getting killed because you had to scratch your nose during combat. Driving?! Are they insane?? If you're not moving your hands from the wheel, what part of you IS moving?! I don't often flex my muscles while driving as that can often lead to involuntary sudden deceleration.
M$ isn't looking to return back on investment for one year, or even a few years when it comes from R&D. They're looking for another alchemist's stone, which has the power to turn bullshit into gold.
That's what they had with Windows and the home PC.
That's what they're searching for now.
while(1) attack(People.Sandy);