Slashdot Mirror


A No-Touching 3D Computer Interface

Justin Schunick points out a video demonstration of a 3D input system which senses the user's hand position, but without requiring the user to touch a controller or wear a trackable position indicator. From the provided description: "Utilizing the theory of electrostatics, we have designed a low-cost human-computer interface device that has the ability to track the position of a user's hand in three dimensions. Physical contact is not required and the user does not need to hold a controller or attach markers to their body. To control the device, the user simply waves their hand above it in the air."

32 of 123 comments (clear)

  1. a 2d drawing application for a 3d interface? by smallshot · · Score: 2, Insightful

    Why? a little counter-intuitive, my tablet can do that much better.

    I think it's an awesome idea, but poorly executed examples.

    1. Re:a 2d drawing application for a 3d interface? by Jurily · · Score: 2, Insightful

      I think it's an awesome idea, but poorly executed examples.

      So what does it do when my hands get tired? Crash my spaceship into the nearest moon?

    2. Re:a 2d drawing application for a 3d interface? by Jurily · · Score: 2, Insightful

      Can't RTFA at work, but the obvious answer is "you make a gesture that signals you're detaching from the controller".

      A full-blown sign language then? How is that better than a keyboard again?

    3. Re:a 2d drawing application for a 3d interface? by Anonymous+Monkey · · Score: 2, Funny

      Because now I can fly my spaceship like those cool ones from Earth Final Conflict. Flailing around like some kind of Idiot lets me do stuff like crash and get captured by hostiles.(And yes, I'm embarrassed to admit I watched that show)

      --
      We are the Borg...
    4. Re:a 2d drawing application for a 3d interface? by samuX · · Score: 2, Funny

      Nice interface, but how do you select stuff? I mean you can highlight whatever you want, but where's the push/click/activate?

      you just slap or double slap your a** to click or double click :-)

    5. Re:a 2d drawing application for a 3d interface? by thenguyens2008 · · Score: 2, Interesting

      I think it's got some potential for many applications. I have always dreamt of working with CAD appz using something similar to this. I use to do CAD hours upon hours with a thrubbing wrist from captain Carpal. Carpal tunnel really sucks and my left hand isn't as skilled in pressing and moving the mouse around. There may be new injuries as a result of this new type of possible repetive movement. I think combine this with a holograpgic image for 3-d appz and we've got a winner....and add voice recognition for menu driven commands.

  2. I'm so sorry... by pHus10n · · Score: 5, Funny

    "...the user simply waves their hand above it in the air..." These are not the droids you're looking for.

    1. Re:I'm so sorry... by Jurily · · Score: 2, Funny

      "...the user simply waves their hand above it in the air..." These are not the droids you're looking for.

      Oh great. So now the Oracle training will include clairvoyance, mind control and lightsaber modules?

    2. Re:I'm so sorry... by Chris+Mattern · · Score: 3, Funny

      "Is Access better?"

      "No...no...no. Quicker, easier, more seductive."

    3. Re:I'm so sorry... by Anonymous Coward · · Score: 3, Funny

      They're shooting holes in my spreadsheet!

      "I've lost $R$2!!!"

    4. Re:I'm so sorry... by JCSoRocks · · Score: 3, Funny

      A no-touching 3D... interface

      Yeah, it seems like every girl I know has one of those.

      --
      You are using English. Please learn the difference between loose and lose; they're, there, and their; your and you're.
  3. Re:Look... by dem0n1 · · Score: 3, Insightful

    Good, I didn't want all those damn dirty, germ ridden, greasy fingerprints all over my nice shiny monitor.

    --
    Why save your soul when you can sell it for a profit?
  4. If my experience with a Theremin means anything... by nani+popoki · · Score: 5, Insightful

    ... then maybe a no-touch interface is not going to work well for me. I found the Theremin to be almost impossible to play because there was no way to get my hand in exactly the same x-y-z coordinate and with the same roll-yaw-pitch attitude (all of which affected the frequency of the oscillator). YMMV, of course.

  5. 5ft x 5ft x 5ft mouse pad? by eatvegetables · · Score: 4, Insightful
    Honey, look at this cool 5ft x 5ft x 5ft mouse pad that I just bought for our laptop!

    Interesting from a tech, nerd perspective I suppose. However, a web cam and a computer vision gesture control app can produce the same effect much more efficiently.

    1. Re:5ft x 5ft x 5ft mouse pad? by GerardAtJob · · Score: 2, Insightful

      But hey... it's cheap and you could use it for cybersex ;) Never underestimate the power of porn!

      --
      I can't call that English ;-)
  6. Touch interface fitness required by worip · · Score: 4, Insightful

    Your arms are going to get tired very quickly using this interface... Maybe we should rather work on perfecting those mind control interfaces.

    --
    A picture is worth exactly 1024 words.
    1. Re:Touch interface fitness required by Fred_A · · Score: 4, Interesting

      Your arms are going to get tired very quickly using this interface...

      Of course not, now you don't have to hold that heavy 5 gram light pen. No more gorilla arm syndrome !
      This guy is a genius !

      Um, wait.

      Do the people who keep on re-inventing those interfaces actually ever ponder why each previous instance failed ?

      --

      May contain traces of nut.
      Made from the freshest electrons.
    2. Re:Touch interface fitness required by Hurricane78 · · Score: 2, Funny

      So if they existed in reality, the Jedi would look more like Jabba the Hut?

      There are things, that you just can't unthink...

      --
      Any sufficiently advanced intelligence is indistinguishable from stupidity.
  7. infuriatingly still by camperdave · · Score: 4, Funny

    For years radios had been operated by means of pressing buttons and turning dials; then as the technology became more sophisticated the controls were made touch-sensitive--you merely had to brush the panels with your fingers; now all you had to do was wave your hand in the general direction of the components and hope. It saved a lot of muscular expenditure, of course, but meant that you had to sit infuriatingly still if you wanted to keep listening to the same program.

    From The Hitchhiker's Guide to the Galaxy, by Douglas Adams.

    --
    When our name is on the back of your car, we're behind you all the way!
  8. A lot of these technologyies. by jellomizer · · Score: 2, Interesting

    A lot of these technologies are really waiting more for computing power to increase to a level where it can support it comfortable, more then new ideas on how to get it to work.

    We know how to take 2 camera and generate a 3d model of what the cameras see. The problem is processing speed.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  9. Re:If my experience with a Theremin means anything by foniksonik · · Score: 3, Interesting

    Just needed to turn down the sensitivity a little... like people who put their mouse on super slow tracking vs. those who prefer a quick twitch approach. Personally I'd like a trackpad replacement with this interface, I don't want to have to move my whole arm around. Make it plenty sensitive or rather make the sensor's grid scaled appropriately for the size of the input.

    --
    A fool throws a stone into a well and a thousand sages can not remove it.
  10. So the reinvented the Theremin? by Zerth · · Score: 2, Insightful

    Except with electrostatics instead of heterodyning?

    1. Re:So the reinvented the Theremin? by artg · · Score: 2, Informative

      No, with USB instead of audio. The measurement is electrostatic either way, but in the Theremin the capacitance change alters the frequency of an RF oscillator. By mixing (ok, heterodyning) against a fixed oscillator, a varying audio tone is produced.

      In this case, it's still measuring capacitance in some form, though with several sensor plates to provide more axes. But the result - however it influences the circuit - is generated as a stream of data over USB. It might even use a bunch of oscillators just like theremins to measure capacitance, but it would be hard to stop them affecting each other.

  11. Carpal tunnel or muscle strain by fprintf · · Score: 3, Insightful

    I don't know about everyone else, but holding my hands anywhere in free space takes quite a bit of energy unless they are hanging at my sides. The reason the keyboard and mouse or other touch surfaces work well is because they allow a person to rest their limbs in an unnatural position.

    So I am not sure about anything that doesn't allow a person to rest... it'd be like using a whiteboard all day long, and that is quite tiring!

    --
    This post brought to you by your friendly neighborhood MBA.
  12. yumm by Canazza · · Score: 2, Insightful

    If I were using this on a desktop, I wouldn't mind wearing a small button on my hand to allow me to click easier (squeezing your thumb and index finger is less effort than moving your whole arm forward) and maybe have a small brace to rest my wrist on, one that gimbals around, to save my arm from being tired.

    If it could be made simpler and integrated with mobile devices I could see it begin a winner though. Tiny mice and track pads are horrible, Touch screens have always been my prefered mobile input device and one that lets me use the computer with my fingers without smudging the screen would make me happy :D
    Do I sense a Theramin app for the iPhone 5G?

    --
    It pays to be obvious, especially if you have a reputation for being subtle.
  13. No touching by Verdatum · · Score: 3, Funny

    Who else read this headline and immediately thought of Arrested Development?
    "No touching!"

    1. Re:No touching by FiloEleven · · Score: 2, Informative

      *raises hand*

      We're not the only ones, either:

      from the in-development dept.

  14. Re:Look... by TaoPhoenix · · Score: 2, Insightful

    Mod Up!

    Make it a hybrid interface.

    Big touchpad where the mouse is now, plus the ability to recognize gestures above it.

    Monitors are for looking at.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  15. Re:!Theremin by TaoPhoenix · · Score: 2, Interesting

    Theramins suk.

    Make this a finger gesture interface. Your wrist is resting, and your fingers can do stuff fairly repeatable.
    (Reboot from BSOD = That Gesture.)

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  16. Re:Theremin??? by Fantastic+Lad · · Score: 2, Informative

    First I want to see what is actually under the cloth, second I want to know if he is just using a multiple pickup therimin, one for each axis.

    I balked at the cloth as well, but stuck out the video to the last quarter, where they pulled it back and gave a short tour of the guts of the system.

    Looks pretty simple. I don't think any new discoveries have been made, but rather the device is a clever bit of engineering using known electrical properties. Applied and scaled correctly, it holds some neat possibilities, though without some form of tactile feedback it might be awkward to manage information with one's hands in that manner. But who knows? Humans are good at adapting. The basic keyboard input seemed pretty impossible when I was a kid, but now my fingers are able to fly across the keys.

    -FL

  17. Re:a 3d I/O application for 1d data entry by MickLinux · · Score: 2, Interesting

    Actually, I think a full-blown sign-language would be great, especially for use with cell phone cameras. There are a few obvious benefits, and some not-so-obvious ones:

    (1) people learn international sign language, and it assists in international communication.
    (2) The speed of data entry would be increased greatly.
    (3) It seems to me probable that there would be decreased cost and possibly (if it was done by a designed/dedicated chip) decreased battery usage by using sign lanugage instead of other means
    (4) Logon would be simplified, with simply flashing a thumbprint.

    How to do it? I suspect that the way to do it might be as follows:
      (1) take an image, and subtract one image's RGB map from the previous image.
      (2) Run an FFT on the result, to get a motion map.
      (3) Track the motion of the various blocks of pixels.
      (4) From the motion of the various blocks, and moreover from what remains invariant and what adds on on one side (or disappears from the other), obtain a 3-D map of various objects. From the 3-D map, and how it morphs, obtain approximate rotation vectors.
      (5) Recognize hands by the digit lengths and connection combinations.
      (6) Plot the hand digit rotational and bending angles into a real-time motion map.
      (7) Translate #6 into specific signs, which in turn can be programmed to be equivalent to international sign language.

    The above method would also allow very high levels of compression of video.

    --
    Correct Horse Battery Staple: 72 bits of entropy. Enter "Correct H" into google. When it generates the phrase, that's
  18. Re:a 3d I/O application for 1d data entry by Jurily · · Score: 2, Insightful

    (1) people learn international sign language, and it assists in international communication.

    I'm a Hungarian, living in the UK, posting on an American website. Don't tell me about international communication.

    (2) The speed of data entry would be increased greatly.

    Compared to a touchscreen, maybe. Assuming of course the software can translate SL into your native language. Compared to a keyboard, this is a joke. Try coding C in sign language, and report back when they let you out from the mental institute.

    (3) It seems to me probable that there would be decreased cost and possibly (if it was done by a designed/dedicated chip) decreased battery usage by using sign lanugage instead of other means

    You mean a high quality (especially considering #4) camera and a custom-designed and -manufactured chip or recognition software with the associated CPU load vs. a $10 keyboard?

    (4) Logon would be simplified, with simply flashing a thumbprint.

    Fingerprint is not a secret. Repeat that until it sinks in. (They use it to catch criminals because we leave them all over the place, you know.)