Slashdot Mirror


Giving Your Computer Interface the Finger

moon_unit2 writes "Tech Review has a story about a startup that's developed software capable of tracking not just hand movements but precise finger gestures. The setupm from 3Gear, requires two depth-sensing cameras (aka Kinects) at the top corners of your display. Then simply give your computer thumbs up — or whatever other gesture you might feel like — and it'll know what you're doing. The software is available for free while the product is in beta testing, if you want to give it a try."

63 comments

  1. Hmm, I may have to clean my desk... by schwep · · Score: 4, Funny

    Now that the computer overloards can measure how messy my desk is I better make the place look respectible!

    Does this mean I need to dress up to use my computer now?

    1. Re:Hmm, I may have to clean my desk... by plover · · Score: 4, Funny

      Now that the computer overloards can measure how messy my desk is I better make the place look respectible!

      Does this mean I need to dress up to use my computer now?

      Pants are optional, but recommended for you.

      --
      John
    2. Re:Hmm, I may have to clean my desk... by Soft+Cosmic+Rusk · · Score: 3, Funny

      Yeah, it might interpret it as a "thumbs up"... Come to think of it, that interpretation would probably be correct anyway.

    3. Re:Hmm, I may have to clean my desk... by Anonymous Coward · · Score: 1

      You're on to something here, Schwepp .. yes requiring to have a camera staring at you to use the computer will enable us not only to look for whatever gestures you are making, we can do a lot of other things. For example we can track your eyeballs and see your pupils tighten in disgust when we place an ad on your screen say for you to eat more soy. That's one thing, there is lots more. Anyhow that's why we want to put a camera into your face and force you to have it on. The day will come when gestures are pretty much your only input option and we already wonder who of you will still sit nude in front of their computers and jack off.

    4. Re:Hmm, I may have to clean my desk... by StillAnonymous · · Score: 1

      You won't even need a desk! We're one step closer to the Johnny Mnemonic user interface:

      https://www.youtube.com/watch?v=bL_8Ugp9zI4

    5. Re:Hmm, I may have to clean my desk... by antdude · · Score: 1

      I thought everyone used their computers nakedly, privately. :P

      --
      Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
    6. Re:Hmm, I may have to clean my desk... by MobileTatsu-NJG · · Score: 2

      Pants are optional, but recommended for you.

      Well, I kinda have to. I keep stepping on it.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    7. Re:Hmm, I may have to clean my desk... by L4t3r4lu5 · · Score: 1

      Pants are optional, but recommended for you.

      Well, I kinda have to. I keep stepping on it.

      Yeah. Haemorrhoids can be a bitch.

      --
      Finally had enough. Come see us over at https://soylentnews.org/
    8. Re:Hmm, I may have to clean my desk... by tehcyder · · Score: 1

      I thought everyone used their computers nakedly, privately. :P

      Only if you live on your own.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
    9. Re:Hmm, I may have to clean my desk... by antdude · · Score: 1

      Well, you can still do it if you're "Home Alone". too. ;)

      --
      Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
  2. ASL translator by n8k99 · · Score: 5, Insightful

    This would be really interesting interface if it had a library of American Sign Language gestures and fingerspelling capabilities.

    --
    For some reason my fountain pen doesn't work here.
    1. Re:ASL translator by Anonymous Coward · · Score: 0

      Interesting idea

    2. Re:ASL translator by b4dc0d3r · · Score: 1

      Right, so thumbs up is a universal sign, and "the finger" is just as universal? It's not in TFA, just in the submission from moon_unit2 who, it seems, is functionally retarded.

      Alternatively, a standardized interface will define how one interacts with the user interface.

      I would think that "ASL", being American Sign Language, would be insufficient to handle anything other than the majority of people. The people who don't sign English, or the dialect known as American, may have trouble translating before signing. Maybe they are bisingual, for lack of a better word.

      In other words, translating hand gestures to a language is interesting. But it requires a common hand language. It seems "30,000 potential hand and finger configurations" would be a superset of ASL, So I should think it would recognise the ASL subset. Depending on the application.

      And that's where it sits, really, the application. One could such an application, and apply ASL to this interface. It might be useful, at least to the deaf community who also understands American English.

    3. Re:ASL translator by AchilleTalon · · Score: 1

      Reading ASL and other countries sign language would require a little bit more work than what has been done so far. It needs facial expressions recognition as well and at least the whole upper body reading. ASL isn't limited to hands and fingers gestures. But, you are right to talk about it. The idea isn't new. The Google glasses would be a better candidate for such a system since it is portable and likely to be ubiquitious in a few years with possibily enough processing power.

      --
      Achille Talon
      Hop!
    4. Re:ASL translator by L4t3r4lu5 · · Score: 1

      Am I the only one who thought "age/sex/location"? Surely you'd need the "11th finger" above the desk for that to work?

      Far too much time on IRC in my youth.

      --
      Finally had enough. Come see us over at https://soylentnews.org/
    5. Re:ASL translator by JasterBobaMereel · · Score: 1

      Thumbs up is not universal - Try using this in some countries and most people will be very offended

      "The finger" is largely unused outside america and not recognised in most of the world

      ASL is only used to sign English, in the USA, by the majority of US deaf people, Other languages in the USA have their own sign languages and e.g. BSL (British Sign Language) English signers would seem to be signing a completely foreign language

      ASL is largely unused outside North America and so is nowhere universal as English

      --
      Puteulanus fenestra mortis
    6. Re:ASL translator by Anonymous Coward · · Score: 0

      It would probably be slightly easier and more useful to get the cameras to read lips.

    7. Re:ASL translator by NinjaTekNeeks · · Score: 1

      I know nothing about this but am curious. Why would people who are deaf be unable to type as well as anyone else? If I was deaf I'd keep a tablet PC with me at all times in case I encountered someone I had difficulty communicating with so I could just type my message.

    8. Re:ASL translator by n8k99 · · Score: 1

      i am not suggesting/asking about this because i believe deaf or the hard of hearing have difficulty typing. it seems to me that if we have speech recognition software, why not have actual gesture/hand-shape based language recognition software. that being said, there are numerous people who are much better communicators verbally than they are as typist, hence the still popular phone call apps on phones. Perhaps, there is a similiar percentage of communicators in ASL, or any other signed language, who are much better at communicating through their first language than through the keyboard interface. Fingerspelling words would at least be something that they are familiar on an fluent level and side step the intrusive typing interface. from what i know of the deaf community, they have embraced technology such as ipads and iphones for exactly the reason you suggest, however these devices are still prohibitively costly for most of that community. yet, despite text messaging being clear and easy communication channels, i still get more Purple phone calls from people in the deaf community than i get text messages.

      --
      For some reason my fountain pen doesn't work here.
  3. The fortune tells by Anonymous Coward · · Score: 0

    With your bare hands?!?

    1. Re:The fortune tells by muon-catalyzed · · Score: 1

      It will not work. The lowest energy input, most precise and fastest controller wins in the end - ultimately some mind control. That is why these Kinect alike devices are fad and not mainstay controllers, you need lots of energy to do even simple things with them and it is often not precise, not fast. The old simple press of a button or an analog stick is way more convenient, speedier and comfortable. In this dark age of manual computer control, that we live in, the precise mice and the fast and dependable keyboard is yet to be beaten.

  4. More uses for black electrical tape. by Anonymous Coward · · Score: 0

    I already have the webcam on my work laptop covered. I'll just tear off a couple of more pieces ...

  5. Not sure if this is a good idea by bakdor · · Score: 2

    When I'm viewing porn, the cursor will just be going all over the place.

    1. Re:Not sure if this is a good idea by Anonymous Coward · · Score: 0

      When I'm viewing porn, the cursor will just be going all over the place.

      Not just up and down?

      Maybe you're doing it wrong.

    2. Re:Not sure if this is a good idea by Anonymous Coward · · Score: 0

      Maybe you're doing it wrong.

  6. Leapmotion by Hunter+Shoptaw · · Score: 3, Informative

    Leap has a system coming in December that does this.

    1. Re:Leapmotion by Anonymous Coward · · Score: 1

      > Leap has a system coming in December that does this.

      May the first to the patent office win a 7 year monopoly, while the other company goes bankrupt. God Bless America.

  7. strangling gesture? by Anonymous Coward · · Score: 0

    Does it support strangling gesture? When you are not content to just insult it. For when you want to wring the computer/software's neck because it is _pissing_ you off? Mostly caused by programs behaving differently/inconsistently for what I would consider standard operations. Or those "helpful" features that you have no clue where/how to turn them off.

  8. Anyone else by Anonymous Coward · · Score: 1

    not want a camera pointed at you just to use the computer?

  9. Every Time I Use A Keypad by Scorch_Mechanic · · Score: 2

    Every time I use a keypad, touchscreen, or other computerized device outside of my own desktop or laptop, I use my longest finger as my pointing finger. This is a habit I picked up my father, who is a longtime computer engineer.

    He and I both find that using the longest finger to control such devices is very cathartic.

    --
    You should turn signatures off.
    1. Re:Every Time I Use A Keypad by ThatsMyNick · · Score: 1

      Interesting, when I use my left hand I use my middle finger, and when I use my right hand, I use the index finger. Never noticed it before, and not sure where I picked these up.

    2. Re:Every Time I Use A Keypad by ThatsMyNick · · Score: 1

      And when am typing (coding) and occasionally using the mouse, I use my right thumb (and very rarely my left thumb). Never noticed these before.

  10. interesting followup project... by Tastecicles · · Score: 2

    ...an immersion environment using a couple projectors behind you and the kinect sensors in front of you (like, in the corners of the room).

    I had a portable projector setup at one point, for the ubergeeky flightsim pilot in me, which ran off of three laptops and two projectors, onto a pair of screens set at right angles to each other: I would be sat or stood at the midpoint of the hypoteneuse to get fairly brilliant very large and almost completely immersive FS experience. Also worked on Unreal Tournament and Quake. It's not quite the same on a pair of 15" Dell panels (yeah, tried it).

    This could actually be the precursor to the Minority Report type interface, but without the glove. Yep, I'd like that.

    --
    Operation Guillotine is in effect.
  11. can it call up your mom for me by Anonymous Coward · · Score: 0

    Yeah, but can it know when I want to fuck your momma, so it can call her up for me without me having to ask. I don't like putting out work for yo mamma the hood rat. If she comes to me, though--AND SHE DOES--then what the hell.

  12. I've already done that by Anonymous Coward · · Score: 0

    I did use Ubuntu, till Unity then I gave not just the interface, but the entire OS the finger.

  13. The deaf by ganjadude · · Score: 2

    This would be something that I would assume the deaf would have a leg up on everyone.

    --
    have you seen my sig? there are many others like it but none that are the same
    1. Re:The deaf by viperidaenz · · Score: 2

      The deaf definitely have a leg up on the paraplegics

    2. Re:The deaf by Anonymous Coward · · Score: 0

      The deaf definitely have a leg up on the paraplegics

      Except for the deaf paraplegics. But I doubt they'd give an arm and a leg for this.

  14. Intel research showed this at last months IDF by Anonymous Coward · · Score: 0

    A combination of a HD camera and an infrared camera.

    They showed several applications and you can register to receive a camera and the SDK, I think they are doing a $1M (or at least a lot) contest for the best application.

  15. Curious by wbr1 · · Score: 2

    What happens when I wave my wang at it. Could have interesting uses in the pr0n industry.

    --
    Silence is a state of mime.
    1. Re:Curious by Nimey · · Score: 2

      That's an easter egg: a picture of Goatse will come up on the screen.

      --
      Hail Eris, full of mischief...

      E pluribus sanguinem
    2. Re:Curious by clickety6 · · Score: 3, Funny

      What happens when I wave my wang at it.
      You'll probably have to adjust the zoom...

      --
      ----------------------------------- My Other Sig Is Hilarious -----------------------------------
    3. Re:Curious by Anonymous Coward · · Score: 0

      Only if you have a 3d display ;)

    4. Re:Curious by Hillgiant · · Score: 2

      I imagine there is a lower bound on the system's sensitivity.

      --
      -
  16. Finally! by endus · · Score: 1

    Finally we can play Strategema without those annoying finger cups. Kolrami is going DOWN this time!

  17. Interesting but I don't want it by doomdoomdoom · · Score: 0

    I don't walk to talk to my computer or have to raise my arms in any way to interact with it. I am at the computer for my job 16+ hours a day and I like quiet and not-tired arms. Now a mind-reading interface would be useful if it were very accurate.

    1. Re:Interesting but I don't want it by tehcyder · · Score: 1

      I am at the computer for my job 16+ hours a day

      Get another job then.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
    2. Re:Interesting but I don't want it by vux984 · · Score: 1

      Get another job then.

      I'm not sure he really has the time to take on even more work.

  18. Leap Motion by Anonymous Coward · · Score: 2, Informative

    Why pay $300 for two Kinect cameras when Leap Motion already has this covered at $70

  19. My cats loves touch interfaces by MSRedfox · · Score: 1

    I picked up an optical touchscreen a while back. It was nifty and kinda gimmicky. Then my cat figure out that she could mess with the computer with her tail when I was grabbing a drink or in another room. Now the touchscreen USB cable is left unplugged. I foresee this having the same issue.

  20. Geeks can do better! by Anonymous Coward · · Score: 1

    I know nobody cares, but people here should care because we are smart and can get things right.

    Kinects are not the only depth-sensing cameras in the market, and therefore the phrase "aka Kinects" is incorrect. You should instead say "e.g. Kinects."

    Since nobody is going to read this anyway I won't bother to explain why. But if you don't want to appear stupid before those who actually understand English semantics, look it up.

    1. Re:Geeks can do better! by sgunhouse · · Score: 1

      Probably meant "a la" (sorry, my keyboard doesn't have the proper accents for French) which mean like or similar to.

  21. keyboard-less-keyboard by futuregeek · · Score: 1

    So can I have my keyboard-less-keyboard now please?

  22. For the people by Das+Auge · · Score: 1

    I know what you mean, it's a shame that keyboard only work for English.

    An American company can program it for Americans, and everyone else can program it for themselves.

  23. Needs to be integrated with eye tracking by Misagon · · Score: 1

    I think that in-air gesture recognition needs to be integrated with eye tracking so that the computer can map hand to screen object from the user's line of sight to the screen.
    Otherwise, there always needs to be a "pointer" of some kind, a proxy, like a virtual hand or pen on the screen.

    It does not need to be a fancy type of eye tracking that detects where your gaze is. It only needs to locate where the eyes are in space.

    --
    "We mustn't be caught by surprise by our own advancing technology" -- Aldous Huxley
    1. Re:Needs to be integrated with eye tracking by Anonymous Coward · · Score: 0

      I like this idea. I messed with a couple of motion tracking projects in school using kinects and I have also done some computer vision based eye tracking. I had never thought of combining the two. I might try this in my free time.

  24. Keyboard tray by Anonymous Coward · · Score: 0

    They say that with this device you can have gestures without putting your hands away from the keyboard.
    Well, seems that for that to be true your keyboard has to be on the top of your desk, not on the keyboard tray, where it is partially covered.

  25. The Finger by Benchevy · · Score: 1

    i wonder if it will be able to see the type of finger gesture, like if you flick the computer off in a joking way over some small frustration, it will be able to differentiate between that and a truly angry flick.

  26. Rugged by Impy+the+Impiuos+Imp · · Score: 1

    > Giving Your Computer Interface the Finger

    Several weeks down the road:

    Statistics Report
    Gesture Classification
    --------
    0.0003% Giving The Finger
    14.27% Using the mouse
    23.42% Using the keyboard
    62.28% Scratching vigorously

    --
    (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
  27. How accurate? by JasterBobaMereel · · Score: 1

    The accuracy might be good, but how accurately can you actually use this...?

    Try putting your fingertip on a small item, did you get it right first time? Now try this when you cannot feel the object, and cannot see it in relation to your hand ?

    Roll on the holographic display version of this ....

    --
    Puteulanus fenestra mortis
  28. Pardon the Ubu by Anonymous Coward · · Score: 0

    it seems finger isn't installed by default, and I'm terribly afraid of $udo. Will who suffice?

  29. Been trying these by Anonymous Coward · · Score: 0

    We've been testing a bunch of these gesture systems at my work and while they are all promising wonderful things and have jazzy looking videos, they are all still very hinky feeling in actual practice. We have a few different systems in our show room and no matter how simple we make the user interface we are trying to control, I can maybe get the right response 10% of the time - even with a much fancier camera than a Kinect. For ones that recognize gestures, you have to be super precise with your hand gesture and even then the system has a hard time recognizing the gesture.

    We even developed one of our own "touchless" touch screens where the touch surface is about an inch above the screen and while that does not involve any kind of gesture recognition, it's awkward to use. It looks fantastic and so futuristic, but we sell almost none of them because they are not comfortable to operate with no touch feedback and sticking your hand up toward the screen without anything to rest it on.

    I question whether these will catch on. Most of them involve waving your hands around in the air, which is an uncomfortable thing to do, not to mention silly. One system we have recognizes when you make a circle with your thumb and forefinger - it looks like you are making the jerk off gesture when you try to use it. I cannot imagine any professional environment where that's going to catch on, though I do understand why it's the easiest gesture to get a computer to recognize.

    I think the tabletop kinds of screens are where it's at with these gesture interfaces, so that you can wave your hands around above a surface, but, how many people use a computer that way?