Slashdot Mirror


German Researchers Show Off a Gesture-Based Interface

smitty777 writes "The folks at the Potsdam University have developed a user interface based completely on hand gestures. A small(ish) device worn around the neck is used to track the hand position, allowing the user to draw, type, or gesture in the air. You think it looks ridiculous when you can't tell that folks are talking on a cell phone? Imagine a bus full of people gesturing in thin air. Also, don't forget to turn this thing off, or it will look like your cat was walking on your keyboard." Update: 06/11 00:54 GMT by T : This informative comment (kudos!) adds links to a video demonstration and the researcher's own site.

69 comments

  1. Watch out! by Anonymous Coward · · Score: 0

    Oooh they are so going to get sued by Apple. This infringes on their, putting a finger near a capacitive touchscreen patent.

  2. First post by NervousWreck · · Score: 2, Interesting

    I'm guessing it would have the problems of the Palm OS graffiti alphabet only cubed.

    --
    I do not have a sig. You are hallucinating.
    1. Re:First post by Shotgun · · Score: 1

      What would those problems be? I found graffiti to be fairly efficient, and much faster than texting with a keyboardless phone.

      --
      Aah, change is good. -- Rafiki
      Yeah, but it ain't easy. -- Simba
  3. German Researchers? by mindbrane · · Score: 4, Funny

    German Researchers Show Off a Gesture-Based Interface

    Shurley you jest sir, this could only have been invented by the Italians. OTOH this would be the equivalent of a mute button for the Brits.

    --
    ideopath @ play
    1. Re:German Researchers? by NervousWreck · · Score: 1

      Perfect! We can market this as the perfect gift for anyone with a British relative.

      --
      I do not have a sig. You are hallucinating.
    2. Re:German Researchers? by Deathnerd · · Score: 1

      German Researchers Show Off a Gesture-Based Interface

      Shurley you jest sir, this could only have been invented by the Italians. OTOH this would be the equivalent of a mute button for the Brits.

      I never jest... and don't call me Shirley!

    3. Re:German Researchers? by fishexe · · Score: 1

      German Researchers Show Off a Gesture-Based Interface

      Shurley you jest sir, this could only have been invented by the Italians.

      Or maybe you mean the French, what with their love of mimes.

      --
      "I don't care about the Constitution!" --Bill O'Reilly, November 17, 2009
    4. Re:German Researchers? by PopeRatzo · · Score: 1

      this could only have been invented by the Italians

      Whoa! I gotta gesture for ya right over here!

      (*raises fist with opposite hand in crook of elbow, in ancient Italian demonstration of deepest respect*)

      --
      You are welcome on my lawn.
    5. Re:German Researchers? by Anonymous Coward · · Score: 0

      How would this work? Would the display constantly go up and down since the eyeties and the frogs are all wankers.

  4. Not good!!! by Anonymous Coward · · Score: 5, Funny

    Remember the last time Germans started waving their hands around?

    1. Re:Not good!!! by networkconsultant · · Score: 1

      I've been giving Windows the Finger for a long time; now when it blue screens It might just reboot :D

    2. Re:Not good!!! by davester666 · · Score: 1

      It's been watching you through your webcam.

      It interprets your gesture as accepting that it has permission to delete and/or corrupt as many files as it wishes before returning control of the computer back to you.

      --
      Sleep your way to a whiter smile...date a dentist!
    3. Re:Not good!!! by prefec2 · · Score: 1

      Last time was the soccer world championship I guess. But I think you are referring to those Nazi idiots. However, as far as I understand that interface, it is helpful to use two. So Nazis won't be able to use it as one arm is always up in the sky. On the other hand it could be seen as a special gesture to blow up the computer.

  5. That's a crappy article. by kurokame · · Score: 5, Informative

    Here's a much better one. There's even a video of the project in action.

    http://www.hpi.uni-potsdam.de/baudisch/projects/imaginary_interfaces.html

    To be honest, it doesn't look like much if you're already familiar with work in the field, but it's probably still worth a quick watch.

    1. Re:That's a crappy article. by Anonymous Coward · · Score: 0

      This.. already i can see a major problem with this device: most people are idiots and lack even a simple imagination.

      Making drawings in the air? The most imaginative drawing people can come up with is making love hearts or sticking up that middle finger. (sometimes found hanging out with the index finger)

      Until augmented reality lenses / glasses grow up, this probably won't go anywhere sadly...

    2. Re:That's a crappy article. by maxwell+demon · · Score: 1

      Well, that would be enough: Love heart for yes, middle finger for no. Gives you one bit. Everything can be made up from bits.

      --
      The Tao of math: The numbers you can count are not the real numbers.
  6. Challenge... by c0lo · · Score: 1

    Design a "hands free" for a mobile with this interface...
    The problem having a small interface to interact with the touch-screen of a mobile is real... but I fail to see how this is actually a solution.

    --
    Questions raise, answers kill. Raise questions to stay alive.
    1. Re:Challenge... by mr_mischief · · Score: 1

      This isn't to use for a mobile phone while driving. This is an interface for a wearable computer (which may also be a phone) when you need to give it visual input. Apparently you'd also still have a Bluetooth headset and voice dialing if it's a phone. With this you wouldn't have to dig out the phone and the stylus* and be limited to such a small input area.

      * If you say a finger is better than a stylus, then you're clearly not considering visual input. Multi-touch is great and all, but draw a coherent picture on your 4-inch phone screen with your finger?

    2. Re:Challenge... by c0lo · · Score: 1

      This isn't to use for a mobile phone while driving.[etc]

      I imagined that. Would one be able to stop Jane/Joe Average using it this way and keep their hands on the wheel?

      This is an interface for a wearable computer (which may also be a phone) when you need to give it visual input.

      Somehow make sense in a mobile device not primarily used as a phone while you are "imaginary interfacing". Don't take me wrong, I'm not dismissive on the idea (on the contrary), but I fail to see a remarkable impact of the applications as proposed by the TFA.

      Without a visual feedback on what you are drawing and the time persistence of what you are drawing I really doubt that one would be able to achieve notable results. Think:
      1. how many times you are sketching something that's good even in a very rough form? (no visual feedback won't let you do more)
      2. how many times is that you don't need the rough sketch to last more than 2 mins? (or whatever the "visual memory" persistence is)
      Maybe I'm biased by my engineering way of thinking: in it's "pure imaginary" incarnation, this is rather a solution seeking for a problem. In it's non-imaginary form, I imagine there are cheaper and less sophisticated means to achieve it.

      Finally, trying hard to find real-life applications also involving smart phones, some /.-ers suggested Sign Language translation. Now, this does make better sense to me.

      --
      Questions raise, answers kill. Raise questions to stay alive.
    3. Re:Challenge... by c0lo · · Score: 1

      This is an interface for a wearable computer (which may also be a phone) when you need to give it visual input.

      Now, give computer visual input sounds better.
      I imagine that the "pilots" of MQ-9 reapers can now "go mobile" and do their job using an iPhone.

      --
      Questions raise, answers kill. Raise questions to stay alive.
    4. Re:Challenge... by mr_mischief · · Score: 1

      I don't think it's a computer's or a phone's job to keep a driver's hands on the wheel any more than a coffee cup's or a burrito's. Enabling someone to use the device without removing hands from the wheel is one thing, but you can't make them keep their hands on the wheel.

      I think for back-of-envelope type things without the envelope, this is a great idea. Sign language translation is a big boon, of course, if they can get that done.

      I don't actually see this replacing a notepad or a PDA, but I do think it has promise as a quick interface for when you don't want to get those things out of your pocket. I wonder how they handle rain...

      Imagine these gesture interfaces with augmented reality overlay glasses so you do have private visual somewhat persistent feedback without taking your perception out of your surroundings. I think that's a good combination, and better than using data gloves to get it.

    5. Re:Challenge... by c0lo · · Score: 1

      I don't think it's a computer's or a phone's job to keep a driver's hands on the wheel any more than a coffee cup's or a burrito's.

      I reckon my initial "challenge" was just a reaction to what seemed to me as an unnatural field of applications suggested by TFA.
      The augmented reality glasses thrown in the combination does make lot of sense.

      --
      Questions raise, answers kill. Raise questions to stay alive.
  7. Two words by tsm_sf · · Score: 1

    Gorilla arm.

    --
    Literalism isn't a form of humor, it's you being irritating.
    1. Re:Two words by Lotana · · Score: 1

      Precisely. I want to see these researchers use this interface non-stop for more than 30 minutes. Gorilla arm is the reason why I believe that any gesture-based interface research will never produce anything actually feasible.

    2. Re:Two words by Shadow+of+Eternity · · Score: 1

      Feasible? No. Satisfying? Possibly. I know I might be tempted to pay for a device that performs a designated action when it detects me flipping off the screen.

      --
      A bullet may have your name on it but splash damage is addressed "To whom it may concern."
    3. Re:Two words by Kenoli · · Score: 1

      There's nothing inherently wrong with a gesture-based interface.
      Quickly drawing simple shapes for whatever reason is not something you're going to be doing for 30 minutes at a time.
      Suggesting that someone do that is pretty silly. You might as well complain about buttons on the front of microwaves. Using those for hours at a time always makes my arms sore.

    4. Re:Two words by c0lo · · Score: 1

      Nokia's concept of Gorilla arm
      (needs sunscreen)

      --
      Questions raise, answers kill. Raise questions to stay alive.
    5. Re:Two words by Hognoxious · · Score: 0, Troll

      Quickly drawing simple shapes for whatever reason is not something you're going to be doing for 30 minutes at a time.

      It's not something any sane person does at all.

      Very cute, solution looking for a problem. Talking of problems, how about this?

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    6. Re:Two words by dunkelfalke · · Score: 1

      Not necessarily. Many mudra for example are made with hand movements only.

      --
      "It's such a fine line between stupid and clever" -- David St. Hubbins, Spinal Tap
  8. No. The Italian's one is *rude* gesture based. by RexDevious · · Score: 3, Funny

    Unfortunately, every time they've tried to demo it, a fight breaks out.

    1. Re:No. The Italian's one is *rude* gesture based. by hedgemage · · Score: 3, Funny

      Italian gesture-based interfaces would be fraught with problems.

      Abraham: Do you bite your thumb at us, sir?
      Sampson: I do bite my thumb, sir.
      Abraham: Do you bite your thumb at us, sir?
      Sampson (to Gregory): Is the law of our side if I say ay?
      Gregory: No.
      Sampson: No, sir, I do not bite my thumb at you sir; but I bite my thumb, sir.
      Gregory: Do you quarrel, sir?
      Abraham: Quarrel, sir? No, sir.

  9. 3 Finger Salute by cosm · · Score: 3, Funny

    I am envisioning a future of urbanites wandering aimlessly as they frantically mash a virtual piano, while in reality they are 3-finger-saluting the air because they can't access their FarceBook or Twatter. Bring on the Windows Mobile Revolution(TM) !

    --
    'We are trying to prove ourselves wrong as quickly as possible, because only in that way can we find progress.' RPF
    1. Re:3 Finger Salute by chromas · · Score: 1

      and you force close hung applications by giving them the bird

    2. Re:3 Finger Salute by cosm · · Score: 1

      Along those lines, 'the shocker' takes on a whole new meaning to power management.

      --
      'We are trying to prove ourselves wrong as quickly as possible, because only in that way can we find progress.' RPF
  10. Original sources by Anonymous Coward · · Score: 5, Informative
    1. Re:Original sources by Anonymous Coward · · Score: 0

      Mod parent up (informative)

  11. Google Translate by by+(1706743) · · Score: 4, Interesting

    Will finally be able to translate from ASL!

    Yeah, yeah, you're probably thinking, "you insensitive clod, I'm from _____." Or making up some clever joke about age/sex/location...

    1. Re:Google Translate by jbell730 · · Score: 1

      You insensitive clod, I'm from _____!

    2. Re:Google Translate by Anonymous Coward · · Score: 0

      Five Underscores? Is that in New Jersey?

  12. What, like this? by History's+Coming+To · · Score: 0
    --
    Please consider this account deleted, I just can't be bothered with the spam anymore.
    1. Re:What, like this? by Jerry · · Score: 1

      Interesting? Yes!

      But, where is the source code he promised to Open Source and release?

      --

      Running with Linux for over 20 years!

  13. Finally.... by Lord_of_the_nerf · · Score: 1

    .....I can make cell phone calls with interpretive dance.

  14. Lawsuits coming ... by tomhudson · · Score: 3, Funny

    Lawyers just love this sort of thing.

    Someone makes a gesture saying "shove it" (flipping the bird, one-finger salute, whatever) and the cop standing in front of them tazes them.

    "There was no warning label saying that gesturing could offend bystanders. I want $5 million."

    [_] I have no hands, you insensitive clod!
    [_] I have no hands because I wanted to see if it would blend, you insensitive clod!
    [_] In Soviet Russia, gestures track YOU!
    [_] You can have my gesture device when you pry it from my ... heck, it'll signal I'm dead - the gesture for that is my hands not moving for 24 hours.
    [_] It's worn around the neck - if I get the hiccups, what happens? Will I accidentally download porn or something?
    [_] Call me when I can attach this to my dog's collar so it can communicate more than "walk me", "feed me", and "rub my belly".

    1. Re:Lawsuits coming ... by Anonymous Coward · · Score: 0

      Lawyers just love this sort of thing.

      I'm sure patent trolls that hire them will love it too.

  15. Is it just my imagination by fishexe · · Score: 1

    ...or did Bezos already patent this?

    --
    "I don't care about the Constitution!" --Bill O'Reilly, November 17, 2009
  16. My cat IS walking on my keyboard by Anonymous Coward · · Score: 0

    You insensitive w3esjbmmmmmmmmmmmmmmm

  17. Obligatory XKCD by ZirconCode · · Score: 1, Offtopic
  18. Yeah right... by ducky101 · · Score: 0, Redundant

    Anything other than complete functional neural interface is a fad at best, and will never ever be used let alone replace keyboard and mouse or touch interface.

  19. Perfect circle by Decollete · · Score: 1

    I wonder if I can draw a perfect circle with this. Using a mouse, mine always looks like a cragged boulder.

    1. Re:Perfect circle by tehcyder · · Score: 1

      You have to nail the mouse's tail down , stretch the mouse tight then move it in a circle. If you have a wireless mouse you'll have to glue a piece of string to it.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  20. Prior Art by El_Oscuro · · Score: 1

    Didn't they have this with Slartibartfast and the Planet Krikkit videos about 30 years ago?

    --
    "Be grateful for what you have. You may never know when you may lose it."
  21. Humm, reminds me of something.... by Anonymous Coward · · Score: 0

    http://fringe.davesource.com/Fringe/Entertainment/Books/HitchHikers_Guide_To_The_Galaxy/1.Chapters/Chapter_12

    "A loud clatter of gunk music flooded through the Heart of Gold cabin
          as Zaphod searched the sub-etha radio wavebands for news of himself.
          The machine was rather difficult to operate. For years radios had been
          operated by means of pressing buttons and turning dials; then as the
          technology became more sophisticated the controls were made
          touch-sensitive - you merely had to brush the panels with your
          fingers; now all you had to do was wave your hand in the general
          direction of the components and hope. It saved a lot of muscular
          expenditure of course, but meant that you had to sit infuriatingly
          still if you wanted to keep listening to the same programme..."

  22. Prior art by Anonymous Coward · · Score: 0

    Doesn't "Natal" already do precisely that?

  23. MIT Medialab has dooe it already by Anonymous Coward · · Score: 0

    havent they?

  24. I wasn't flipping you the bird! by Arancaytar · · Score: 1

    Honestly!

  25. Pranav Mistry's MIT version demo'd 2009 TED by OldeClegg · · Score: 1

    This sure looks like the gimzo that Pranav Mistry developed at MIT. Here's a link to the demo of same at TED, last year: http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html

  26. Come on by kvezach · · Score: 1

    Come on, all these posts and no reference to Minority Report? For shame.

  27. Cat by Anne+Thwacks · · Score: 1

    My cat is walkign on m,y keyboard, you insesnitive clod..

    --
    Sent from my ASR33 using ASCII
  28. From the article by Anonymous Coward · · Score: 0

    and like mimes, people can

    No. Any idea that can be described with the line "like mimes" I don't want to have anything to do with.

  29. Feedback? by MrBandersnatch · · Score: 1

    It would seem like a bad idea at the conceptual stage since this idea violates one of the most fundamental HCI principles of providing the user with feedback, but reading the "article" it seems like what these researchers are looking at is how the use of gestures can be projected to aid in remote communication between individuals (rather than this actually being a full interface technology...at this point). Great, now we can look forward to people using their talking loudly on their mobiles phones AND gesticulating wildly!

    Anyways, this is a kind of "post-it note" of gesture technologies and while I dont feel it adds much to the field *practically* (i.e. I'd love to see someone with some good gesture recognition algs that just work) I'd be interesting in seeing some of the evaluation metrics on this since my primary concern would be that people just wouldnt grok it and if they do, I'd suspect that the additional cognitive load would render anything but the most basic interactions (i.e. post-it notes) useless.

    Speaking of useless, they have also done some research on projected touch. Anyone else think...."well, why not just use VLC"?

  30. t-shirts by Larafabian · · Score: 0, Offtopic

    WOW. This is the first article I’ve read since finding this siteand what an article!!! I’m hooked. I think nobody can be brief as like your post! Cheap Online Whole T-shirts

    1. Re:t-shirts by selven · · Score: 1

      You kinda need a link or some kind of address for your useful and relevant advertising to actually reach the people that need your product. Maybe consider putting one in next time?

    2. Re:t-shirts by tehcyder · · Score: 1

      As a spam that is an epic fail.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  31. Douglas Adams foresaw the consequences... by thbb · · Score: 1

    The machine was rather difficult to operate. For years, radios had been operated by means of pressing buttons and turning dials; then, as the technology became more sophisticated, the controls were made touch sensitive ... now all you had to do was wave your hand in the general direction of the components and hope. It saved a lot of muscular expenditure of course, but meant you had to stay infuriatingly still if you wanted to keep listening to the same programme.

    D. Adams, The hitch-hikers guide to the galaxy. Ch. 12.

    BTW, a envisionment of natal in 1993, with datagloves: Charade, remote control of objects using free hand gestures published in Communications of the ACM. (Here for ps version)

  32. Hand gestures... by SiaFhir · · Score: 1

    Italians will *love* this interface!

  33. Combine with Augmented Reality by BJ_Covert_Action · · Score: 1

    Combining something like this with a set of augmented reality goggles and a wifi chip (if we ever get ubiquitous broadband) could make for some really fun lunch breaks and such. Just imagine logging into a 3D shooter game with your goggles in such a way that everyone else logged into the game got marked (through augmented reality) with some sort of indicator (virtual costume or something). Then, using your new hand gesture control system, you could run around and, 'shoot,' at each other with a gesture of your hand while it is pointing like a gun. It would be less dangerous than paintball, less painful, and, hopefully, require less gear than typical laser tag. All in all, it could make for some really fun augmented reality real-life games.

  34. Already done before? by togoshigekata · · Score: 1
  35. HandVu similar, code available by MauiMaker · · Score: 1

    Interesting. It kinda replicates the 2004 PhD thesis of Mathias Kolsch when he was at UCSB (now at the Moves Institute, NPS). Mathias's work is known as HandVu. The source code for HandVu is available on that web site, along with videos.

  36. unforunate side effects by hydrodog · · Score: 0

    Most gestures seem to result in Poland being overrun....