Data Glove That Turns Gestures Into Commands
ravidew writes: "Three students at Berkeley Sensor and Actuator Center, University of California, have built a motion-sensing glove that can transmit hand gestures to a PC. Within 3 years they hope to build sensors that are no bigger than 1mm and can be glued to each fingernail. Now you can really tell Windows what you think ..." While you're at the Sensor and Actuator Center, check out Kris Pister's smart dust.
where the point was made that you might not want your pc to know where you hands are at all time... Dave, about last night...
Shift happens. Fire it up.
Am I the only one who remembers where this will go? Check Douglas Adams' Hitchhiker's Guide to the Galaxy and remember -- in the future, you'll have to sit reeeeeaaaaally still to keep your PC from reformatting itself.
They that would sacrifice their
fdisk deleted my ext2 partition! crap!
This looks familiar...
:)
Can I play Super Mario Bros. with this one?
One a serious note, while it looks pretty cool, you can't help but think it will prove to be less useful than the traditional methods "used to decipher and translate hand gestures into computer interepreted symbols". Still, it's only there to prove it could be done. Who among the programmers out there wants to tell me if they;d find this useful?
Sham on
Of course, the gesture command for dismissing annoying pop-up ads should be obvious, depending upon whether you are using LOCALE=en_US or LOCALE=en_UK.
www.eFax.com are spammers
If this catches on, we'll be typing with sign language.
What you need is a way to program the glove to recognize certain rythmic motions and to interpret that as writing code. Back and forth, side to side, whatever, it would have to conform to certain preferences of the user. These motions are then interpreted and translated into functions and subroutines for whatever application you are writing.
"Few, I am exhausted. I just pulled off 10 lines of code!"
"I just do not have any more code in me for today..."
Now you can get back to your own sick mind.
Troll Like a Champion Today
Gives new meaning to the "three fingered salute!"
=-=-=-=-=-=-=-=-=
Oh bother.
I rather have voice recognition than hand gesture recognition... Its such a pain to gesture to a computer... Remember the 'Black and white' (game) gesturing thing... it took so long to get it to actually recognize the gestures... and there were only a few and they were only 2D... a human uses hundreds if not thousands of gestures that are very similiar... I really wouldn't want to be the person designing the software to interpret the gestures...
Anyone out there do this sort of programming? How hard is it to get a computer to understand complex gestures???
---
Programming is like sex... Make one mistake and support it the rest of your life.
Development info and software available
Adapted uses of the Power Glove to VR world navigation
History of the Power Glove
"Mod, mod, mod...and another troll bites the dust."
Interesting stuff. Power supply, optical and processing capabilities, sensory systems, all in a 1.2mm package.
Massively manufactured, at large scales could make for some very interesting deployment opportunities...
Of course, the nefarious applications for this sort of thing are pretty obvious.
And yet, that still shouldn't be a reason not to develop this technology.
; -- the corruption of government starts with its secrets. a truly free people keep no secrets. --
Attacking human-comp interfacing on all fronts is surely good, but optical and voice control are higher on the evolutionary scale than ever-more sophisticated manual data entry devices. Pyramidal keyboards, data gloves, et al are all variations on an inferior theme. Keyboards, mice, trackballs, joystics, are incredibly inefficient compared to how fast our minds and our computers can process data. That's the real bottleneck right now, not the bus or platter rotation. This glove is just a new and improved way to get carpal tunnel.
There are already experiements with direct patching into the brain, and just think of the virus possibilities of running Outlook on that platform.
It was called a Nintendo Power-Glove.
I've also seen schematics & drivers so that you can connect your power glove to a serial port & use it as a mouse replacement.
There are a thousand forms of subversion, but few can equal the convenience and immediacy of a cream pie -Noel Godin
The blue screen of death,
My middle finger extends:
Control-Alt-Delete
I don't know if anyone else remembers the powerglove, one of the silliest things nintendo ever released. The original nintendo system had the ability to accept remarkably versatile input, from a whole range of weapons (actually crappy cameras) to the tactile sensative power glove, power pad, and even a device that sensed hand position in midair with infrared(it folded open like a laptop and sensed the airspace above it.) I actually had the powerglove, and you know what? It was rather useless. No way making gestures is simpler than well placed keys. Anyone here who codes should understand that more mouse movement=less efficiency. I'd say that for now, we have to play on the computers' terms, and use a simple system relying on muscle memory that contains no ambiguity. Maybe eventually the computers can learn to understand subvocalized commands (like in the ender Quintet by Orsen Scott Card) or even mental ones, but until then, I'm afraid that the simpler the system, the better it will work. Mike Tyson's Punch Out really sucked when you actually had to punch with the glove!
My Karma is so good, I'm the Dalai Lama...or something.
When it comes to video games, the wave of the future is force feedback, because when we get input from the input devices it makes them more intuitive to use.
When we're actually trying to get something done with computers, we wave our hands in the air because it removes contact from devices, gets rid of all force feedback, and. . . well. . . er. .
Nintendo Power Glove.
Used more for VR and hacking than any other interface in the early 90's. I was able to map commands to gestures in DOS, and to some limit in linux around 1996.
The fact that it isn't bulky or cyber-looking like the powerglove was and hopefully it doesn't have that nasty Ultrasonic rangefinding.
Do not look at laser with remaining good eye.
I like the one that looks out the back window.
Oh, the software! I thought XP could read my mind and phone home about it.
Really though, do you think the company that has yet to embrace multiple virtual screens and mice with three buttons properly, will ever use this? Sure, the prototype uses Win95 (at least they knew better than to use MS for web stuff. quoth the page, "meta name="GENERATOR" content="Mozilla/4.75 [en] (X11; U; SunOS 5.7 sun4u) [Netscape]"") Will MS really pick it up and make it available with their GUI? I think not. Xfree86 will beat them to real and invovative uses for the interface by years!
Kudos to Hollar et al. This is a cool glove. MJ wants to know if you have one with rhine stones.
Friends don't help friends install M$ junk.
Think about it. You have these sensors in each of your fingertips and any flat surface becomes an instant full-size keyboard.
It also one-ups the mouse-keyboard combination, no more mouse/touchpad. Just lift your forefinger off the virtual keyboard and move the mouse pointer by pointing at the screen. Your fingers never have to leave the home-row.
For those that can't touch-type, unroll a cheat-sheet and type on it.
This will be a GREAT technology once it matures.
I did the same thing at UIUC back in '97...
I used dual 3-axis accelerometers for the hand motion, and discrete switches to determine
finger joint position. The wires were sewn into the glove directly.
The result was very accurate hand movement, with the trade off of less complex finger movements.
Needless to say, I like the idea. It is a _very_ natural interface for a lot of applications. The glove is a little unwieldy, but for some reason beyond comprehension, everyone who does this seems to build theirs around the heaviest winter glove they can find... What someone needs to do is to build this using discreet sealed components, on the outside of thin, air-holed neoprene (similar to a bicyclist's glove.)
Also, the software is the key to whether this really works out. You need a virtual keyboard app (similar to what pen laptops use), plus a gesture pad (a la grafitti or CAD gestures), plus a standard mouse driver. (I never got around to polshing my software beyond anywhere other than manipulating a Rubik's-style 3D Cube. No, you couldn't acutally solve it.)
The strange thing is that in keyboards and WIMP user interfaces, we seem to have reached a point where it is far from obvious where we can progress next. There hasn't been significant progress in user interfaces since the 1970s when Xerox Parc developed the mouse based interfaces which we all use today - oh sure, we have colour, and that paper clip, and skinability, but none of these are anything other than incremental enhancements.
Many people are betting on 3D user interfaces, but I remain unconvinced that these will actually be useful, or that a 2D representation of objects in 3D would be better than the 2D representation of objects in 2D which we have now.
Most new input devices are also variations on the mouse theme, be they light-pens (hardly new, I remember them in the mid-80s), touch screens, or these gloves.
So the question is, have we reached a global optimum in user interface design, or is there some other approach that I haven't even considered that we will all be using in 30 years?
What's more, they combine this idea with haptics, attaching motors so that when you interact with objects, they push back on you. You can even rest your hand on an object and have the motors support the weight of your arm. Very Cool.
http://www.immersion.com/products/3d/intera ction/o verview.shtml
Somewhere, something incredible is waiting to be known. -- Carl Sagan
If:
The crotch-scratching motion is detected on a regular basis, you might get more pop-up ads for Gold Bond Medicated Powder.
Likewise, another common motion among those who sit all day might put some Preparation H commercials in your future.
Your typical 13-year-old might get more porn adverts, 'tis true...
The common nose-picking gestures might queue some Kleenex adverts up for your viewing.
Yes indeed, we should all sign up for this technology as there is no doubt that it will improve our lives beyond measure.
I'm trying to teach myself to set people on fire with my mind... Is it hot in here?
From todays earlier piece on Thermoelectrics.. So eventually you have the fake fingernails that never need replacing and can control your T.V.. I just know what gesture I'd program for Jerry Springer.
Forget smart dust, I want smart liquid!
I want to be able to DRINK an upgrade and have it interface with me directly. A pint of CPUs on the house! That way I can drink and actually get SMARTER instead of the current opposite result.
- For the complete works of Shakespeare: cat
Anyway, I have a feeling, like gasoline, television and so many other legacy tools that are so entrenched in our lives, this will be slow to catch on. I'd like to be an early adopter but I'm not smart enough, heh...
Our natural communication tools should be our interface to our machines...
Luck favors the prepared, darling.
Yes, I know it wasn't the best movie ever made, but it had the goofiest dataglove gestures I've even seen or imagined. Gave new meaning to pointlessness. (Much like this post).
I'm the stranger...posting to
Giving the finger could run fsck on your active partition...the words are close enough...
I pledge allegiance to the flag...
of the Corporate States of America...
The first time you sneeze or cough or answer the phone you could end up with all sorts of gibberish, or maybe even rebooting your computer.
It seems to me that you need some sort of disconnect override. Maybe some sort of camera that can tell when you're looking at the screen. (I seem to recall hearing something about that on here in the past...)
Let's say I'm playing CS. Not only would this help me position keys anywhere I wanted but instead of a mouse just point at the guy you want to shoot.
I've seen, somewhere, a keyboard made for gaming (central arrowkeys with conveniently placed programmable buttons around it) but this would be that all hollow. Just think about it for a second... any key, any where you wanted it! Programmable, personalized, keyboards!
(Damn, now I want one of these things sometime tomorrow).
No sig for you.
Any other Mac users out there remembers MacPlaymate?
I can see devices like this used to control complicated Battlebots, combined with a headmounted display and voice commands. Forget a bunch of joysticks, buttons, and switches, just assign different functions to different hand movements. Or just put some robotic hands on it and literally grab and toss your opponent... There must be some weapons configurations that haven't been practical due to control system limitations. Now if I could just figure out a way to get them to let me start a project on this at work...
...as if there were not enough discrimination against older programmers already.
Just assign different "hand positions" to all the meta-keys the editor uses. i.e.:
palms-down = normal
palms-45-degrees = ctrl
palms-sideways = alt
palms-up (yikes) = meta (or whatever)
etc.
and "type" normally.
And for vi, just turn your wrists sideways a bit to enter "edit mode."
Never mind, this is a stupid idea.
"Reactionaries must be deprived of the right to voice their opinions; only the people have that right." - Mao
Although the technology is certainly impressive, I have to wonder if this really would produce a better input device than the manual devices we now have:
Can it be used to input text more rapidly than a keyboard?
I doubt it. The example which comes to mind is how Palm decided to deal with the difficulties in handwriting recognition; that is, by devising their own alphabet and forcing the users to learn it, rather than designing software which attempted to understand each individual's idiomatic writing style. The designers of this glove interface would face the same decision -- and it's important to remember that many attempts at user-adaptive recognition have failed. So, assuming that users would have to learn a gesture alphabet to use the glove, how fast could they "type?" Although I've practiced Graffiti diligently, I seem to top out around the 30 wpm which Palm claims is the maximum. On the other hand, I can easily type 90-100 wpm on a keyboard.
Can it be more intuitive and/or more precise than a mouse?
Again, I doubt it. The screen, the tabletop that the mouse moves on, and the desktop software (X, Windows, Mac, etc.) are all designed for 2-D interactions. What's the use of having an extra degree of freedom with the controller? I'm sure that it would be possible to develop a 3-D desktop environment, but what about all of the 2-D standard applications? I doubt that I could get the same precision drawing objects in PowerPoint, for instance, using my whole arm (or at least my forearm) for hours a day than I can with a mouse. Fatigue would eventually cause a lot of inaccuracy.
Speaking of fatigue...will this input device be more helpful for avoiding repetitive motion injuries?
I'm not an ergonomics expert, but it seems as if you would be prone to repetitive motions of a different kind. Yes, using keyboards and mice for hours a day is a bad thing in the long run. But is trading carpal tunnel syndrome for, say, tendinitis in the elbow any better of a situation?
I'm sure there would be SOME use for this kind of technology. But I don't see it as being a wholesale improvement over current input methods for the kinds of systems we have. Although I usually hate to use the word "paradigm" in polite company, I think it's fair to say that our whole notion of computing is built on a "flat paradigm", for better or worse. Ultimately, we will have to design different displays and ways of thinking in order to restructure our interactions with computers. It will take more than a glove.
(Whew...got through the whole post without making one Michael Jackson joke...)
"she says i'm lousy conversation. as if that's supposed to help."
I think that this might be useful in situations where a keyboard is needed sometimes but is inconvenient in other situations. If anyone here saw the Final Fantasy movie, you'll know what I mean - one of the characters prompted a holographic keypad/interface to come up which she typed on, and then caused it to dissapear when the bad guys came and action was needed.
$45 per U Colocation Special
Now all we need is a new clause in the Mafiasoft Windoze license agreement in addition to some innovative technology. The clause would state that you shall not flip off Mafiasoft Windoze. The technology would be a double-barreled shotgun mounted to a robotic base on top of the computer monitor. This shotgun would be fired by a solenoid controlled by Mafiasoft Windoze. Every time Mafiasoft Windoze detects that it's being flipped off, it will simultaneously perform two innovative actions:
1. It will fire the shotgun at the user's head, roadrage-style.
2. It will reboot and display the following message:
Mafiasoft: Where do you want to pay today?
Sounds like what Jaron Lanier was doing 30 years ago. You can read all about it in Howards Rheingold's excellent book Virtual Reality circa 1991. (not to take away from their efforts.)
Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
Imagine one of these things with force feedback. Online Arm Wrestling. :)
On a more serious note: More accurate long distance surgery.
SIGFEH
You might want to check out the SmartBoard by Data Desk. It's a nicely laid-out split keyboard with low-force mechanical keys. It's a little loud, but boy does it feel beautiful. The layout might look odd to begin with, but I found it very easy to adapt and I'm a fucking fast typist. Plus it's only $70, which in these days of cheap Microsoft Natural knock-offs and $300 UberErgo boards is a pretty good deal.
This isn't as much "normalization" as it is "don't take so many drugs when you're designing tables."
Over the last 10 years or so, I've seen tons of this lowend VR stuff try to pop-up and fizzle right away. The PowerGlove is about the only glove device - IIRC this is due to some patent that VPL has on "using a glove device for input".
And there have been tons of 3d glasses that have come and gone - I've even got a video card in my machine that has a special hookup for 3d glasses and of course you can't find any.
So, is there any chance of this stuff ever making it onto the shelves of Best Buy or CompUSA?
Some more information can be found at the FAQ.
And some images are located there:
Don't answer me. Moderate. Slashdot is about moderation, not discussion.
Now you can really tell Windows what you think ...
;o)
That would be like giving sight to the blind. I've yet to come up with wording to describe what I think when I use Windows. let alone a gesture that would do suffice.
"Sounds like what Jaron Lanier was doing 30 years ago"
" Lanier was born in 1960. Inventing a data glove in 1971 when he was eleven, only shortly after the first mouse was built, would have been impressive indeed.
OK, admittedly I exagerrated, and I should have said 'working on' , not 'doing.' was trying to remember back to 1991, when I read "Virtual Reality" in all fairness though.
Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
There's a little company in Pretoria (in South Africa) called 5DT that has been producing data gloves that can be used as a mouse for quite a while now. Check out these links.
Their homepage.
Their hardware page (includes data gloves).
One of the data glove pages.
Now in order to reboot Windows, all you have to do is flash your computer the bird.
GreyPoopon
--
Why is it I can write insightful comments but can't come up with a clever signature?
I can't find the obligatory Beowulf post :-) It's actually applicable here - one of the more interesting things to do with Smart Dust and similar locator technologies is for them to talk to each other about where they are and to detect changes in their relative positions. It's not just a server thing. Vernor Vinge's book "A Deepness In The Sky" has a lot of discussion about what you could do with locator smart-dust; it's obviously speculative fiction, but it does a great job of looking at the potential for technology.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
Vernor Vinge's book "A Deepness In The Sky" has a lot of discussion about what you could do with locator smart-dust; it's obviously speculative fiction, but it does a great job of looking at the potential for technology. Think about the effects of small (fictionally nanotech, but really small is probably enough) devices that communicate with their neighbors, have some computing power, and can do relative location detection. What could you do with that?
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks