Slashdot Mirror


Gaze Gaming Tech Promises Faster Eye-Controlled Interaction

NewScientist is reporting that further research is progressing on new types of user input devices. Specifically, "gaze gaming," a technology that promises faster interaction using only your eyes. Currently technology for sight-based interaction is far too slow for practical applications in things like gaming. "Eye-gaze systems bounce infrared light from LEDs at the bottom of a computer monitor and track a person's eye movements using stereo infrared cameras. This setup can calculate where on a screen the user is looking with an accuracy of about 5 mm."

34 of 141 comments (clear)

  1. Imagine turning this technology into a mouse by Smeagel · · Score: 2, Interesting

    While your finger sits on a touch sensor (unmoving, relaxing) your eyes act as the mouse curser. You blink to click. Perfect interaction.

    1. Re:Imagine turning this technology into a mouse by speroni · · Score: 4, Interesting

      Blinking could be an issue, you're going to do that involuntarily. Maybe with an extra long blink, or specifically one eye for a click (Then you could get left and right clicks) you don't generally close one eye involuntarily.

      I was thinking a contact lens with an inlaid tracker could improve the accuracy.

      I already have suspicions that sitting in my cubical in front of my good old CRTs and other equipment is already unhealthy enough, wouldn't want to add more EMR in my face on top of that. Although I know there's nothing inherently unhealthy with IR EMR...

      --
      Eschew Obfuscation
    2. Re:Imagine turning this technology into a mouse by ivan256 · · Score: 2, Informative

      Now they just need to get it down to .5mm resolution...

      In other words, it needs at least a 10x improvement to be a mouse replacement with current UIs.

    3. Re:Imagine turning this technology into a mouse by dreamchaser · · Score: 2, Insightful

      Human's eyes dart around way too much for that to really be workable IMO. As an adjunct to a mouse for fast targeting it might have gaming and military applications though.

    4. Re:Imagine turning this technology into a mouse by StarfishOne · · Score: 4, Informative


      Darting eyes indeed!

      Why oh why do I have to think about a situation I was in a few years ago.

      I was taking driving lessons together with a friend of me. I was sitting in the backseat when the driving instructor was explaining how it was very important to look ahead, but also that _you will tend to go wherever you are looking_.

      And as if to emphasize the importance of this, our sometimes playful Universe introduced a few seconds later this synchronicity in the form of one of the most stunning blonde girls we have ever seen.. (oh those legs!)... my friend almost hit the sidewalk and I can still hear our driving instructor saying: "SEE!? That's what I mean! Keep your eyes on the road"

      It was such a brilliant moment. :D

    5. Re:Imagine turning this technology into a mouse by pherthyl · · Score: 4, Informative

      Well I work on these kinds of systems, and that 5mm is not a limitation of the system, it's a limitation of the eyes.

      The fovea (dense area of rods and cones) in the retina is large enough to give you approximately a 1 deg cone of "focus". Which means depending on the distance, you can focus on an area of a given size on the screen. So even with a perfect eye tracker, you cannot pinpoint gaze location exactly just by measuring eye orientation. Accuracy depends on distance from the screen, but 5mm is in the ballpark for what you can achieve (and that is with a perfectly calibrated system, real accuracy will be worse).

    6. Re:Imagine turning this technology into a mouse by Dachannien · · Score: 5, Funny

      or specifically one eye for a click (Then you could get left and right clicks) I can see it now: all the Apple fanboys poking out one of their eyes to make themselves "compatible".

    7. Re:Imagine turning this technology into a mouse by mikael · · Score: 2, Informative

      A google search for "eye tracking hardware" will give a good range of companies.

      There are actually LCD monitors which actually have built in eye tracking hardware.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    8. Re:Imagine turning this technology into a mouse by fractoid · · Score: 3, Interesting

      I can't help thinking that using gaze tracking as a primary cursor is (with the exception of physically disabled users who *can't* use a traditional pointing device) somewhat missing the main potential.

      Gaze tracking seems to me to be perfect for a secondary 'information' cursor. Wonder what the date is? Look at the clock on your taskbar and the calendar will pop up. Curious what guild that undead priest over there is in? Simply looking will give you some transparent overlay text detailing guild, current health/mana, and what spell he's casting. Cast your eyes to a person's name on your IM list and it'll tell you when they were last at their computer and what their status message is.

      Another interesting thing I remember reading about was using eye tracking for security. The whole screen is a ramble of random characters, except the precise area of interest being focussed on, which is unscrambled. The viewer's brain assembles what they see into an unscrambled screen, and any onlooker just sees junk.

      --
      Rampant carbon sequestration destroyed the Dinosaurs' tropical paradise. I'm here to help repair the damage.
  2. Retinal image by FrankSchwab · · Score: 2, Interesting

    I always wondered if you could do more precise gaze detection by looking at a person's retina. Could you detect where they were looking on the screen precisely enough to eliminate the need for a mouse cursor (say, within one character space)? How large is the area of sharpest vision? /frank

    --
    And the worms ate into his brain.
    1. Re:Retinal image by MuValas · · Score: 3, Interesting

      The problem is what a person is cognitively focused on isn't necessarily what they are visually focused on. We've worked on vision-tracking systems for a long time, and this basic fact stymies most uses of the technology. We have had numerous devices that bounce various types of light off the retina for tracking, and people that use it complain that sometimes what they are focused on, and what their retina is apparently focused on, is different.

  3. Sounds like the Great Equalizer... by amplt1337 · · Score: 2, Insightful

    at least for FPS.

    Otherwise, mostly a Gee Whiz! tech, though I suppose it could have useful applications for the disabled. But I wonder if we won't see wrist-based Repetitive Motion problems transferred to increased eyestrain...

    --
    Freedom isn't free; its price is the well-being of others.
    1. Re:Sounds like the Great Equalizer... by jollyreaper · · Score: 2, Funny

      No. With blink controls, the great equalizer will be mace.

      --
      Kwisatz Haderach
      Sell the spice to CHOAM
      This Mahdi took Shaddam's Throne
  4. I hope this is not only for games by Simon+(S2) · · Score: 4, Interesting

    It would be really useful to be able to move the cursor only by looking at the point on the sceen I want it to be. That could save my wrist from carpal tunnel syndrome and it could also incement my productivity by making the pointer go quicker to where I want it to be. I hope it will have pixel accuracy, but even if it does not, I am sure, time a few years, it could become the perfect input device.

    --
    I just don't trust anything that bleeds for five days and doesn't die.
    1. Re:I hope this is not only for games by PatboyX · · Score: 2, Insightful

      Maybe the problem is that we are thinking of using this new tech for existing and somewhat limited metaphors for a workspace. If we start with this as an input method, maybe we would create a workstation that would address the above issues such as wanting to be able to interact with something I am not focusing on, accidental blinks, etc. So...yeah, start working on that.

  5. Re:Imagine RSI in your frickin' *eyes* by ParaShoot · · Score: 3, Interesting

    I doubt RSEye (to coin a term) would be a problem, given that your eyes are constantly in use in everyday life, and very much used to moving small distances repeatedly. Chances are that your eyes are following your mouse cursor anyway, so the net increase in eye movement is zero, with the added bonus of avoiding repetitive mouse clicks.

    Eyes are designed for frequent, small movements. Fingers aren't.

  6. So... this means... by i+kan+reed · · Score: 4, Funny

    This means Nintendo's next generation of console will be called the sii?

  7. Ok, I only see one issue by Aranykai · · Score: 3, Insightful

    There is going to have to be a very accurate system of "disabling tracking". I mean, take the FPS example. How often am I going to be spinning around when I glance down for a quick ammo count?

    Or, if you look up to check your HP/MP in an MMO, will you be randomly changing targets, or worse, disengaging them to move?

    Its an interesting idea, definitely useful for somethings, but it shouldn't ever take the place of a mechanical pointing device like a mouse or trackball.

    --
    If sharing a song makes you a pirate, what do I have to share to be a ninja?
  8. What about four eyes by icebike · · Score: 2, Interesting

    Some of us need glasses just to see up to the screen. How will this work with an additional semi-reflective layer interspersed?

    --
    Sig Battery depleted. Reverting to safe mode.
    1. Re:What about four eyes by pherthyl · · Score: 2, Informative

      It will definitely interfere. Depending on the glasses (reflectivity and material of the frames), the environment (ambient light, glare), and the system, you will get different results. I have some experience with a $40000 eye tracker from Tobii (they're pretty much top of the line trackers) and it still has issues with glasses.

  9. Selective Rendering by jannone · · Score: 4, Interesting

    For single-player games, this device could possibly enable some sort of selective rendering technique, where the objects sitting at the focal point are rendered in much more detail than the periphery.

    1. Re:Selective Rendering by pherthyl · · Score: 4, Interesting

      Yes, this has been done and works quite well (the user doesn't notice any difference). The problem is in the reaction time that is necessary. The last study I read found that the high detail rendering must be performed within 5ms of a fixation to make the experience seamless to the user. That's a problem for most applications, as they won't be able to react that quickly.

  10. Continue use? by __aapbzv4610 · · Score: 2, Funny
    FTA:

    Technology is being developed to allow people with severe motor disabilities to play 3D computer games like World of Warcraft using only their eyes. So WoW players whose bodies atrophy from lack of getting up doing things in the real world would through this system be able to continue playing?
  11. Hand/Eye Coordination... by probityrules · · Score: 2, Funny

    Now we can farther yet remove gaming from pesky physical activity. It's no longer even a matter of good hand/eye coordination: just good eye coordination.

  12. Shifty eyes by Rob+T+Firefly · · Score: 4, Insightful

    This seems like a good idea in theory, but in reality we rarely keep our eyes fixed on any point with all that much precision. Our eyes are always shifting around to get a bigger picture of things most of the time, even when we're trying to hold a steady gaze on something. Trying to precisely control a game, or anything else, with one's eyes seems to me like much more trouble than it's worth.

    1. Re:Shifty eyes by pz · · Score: 3, Informative

      Have you tried? Sounds like maybe you have not.

      I have. I'm a visual neuroscientist and my research involves accurate measurement of eye position. I also own a relatively high-end SLR camera that senses eye position to control focus (this is not a coincidence). Humans have exquisite control over their eyes. With a good low-latency mechanism to read gaze position, system control (camera, computer, whatever) becomes incredibly quick, efficient, and fluid. The only problem is that you do NOT want the cursor to always track your eye position, you need a switch: sometimes you want the cursor where you are looking, sometimes you want to leave the cursor in place and look around. But this switch is no more than the equivalent of a mouse button, a shift key on a keyboard, or a foot switch. All work, although I prefer the keyboard approach.

      --

      Put my fist through my alarm clock with its ding-dong death inside my ear. - The Blackjacks.
  13. Oh no! by ghstomahawks · · Score: 2, Insightful

    Forget "the great equalizer". With my lazy eye I'll be staring up at the heavens spinning in circles all game long ... that is all game until my head gets blown off repeatedly.

    1. Re:Oh no! by speroni · · Score: 2, Informative

      I imagine you would have to build in a calibration feature. Everyone's facial structure and eye placement and such are all slightly different. When you install the hardware, you'd get click this X over here, and that X over there, adjust your sensitivity etc... and if done properly it could compensate for quite a bit of variation.

      --
      Eschew Obfuscation
  14. As long as no lady's chests in image by Maxo-Texas · · Score: 3, Interesting

    I remember the pepsi commercials back in the late 70's/early 80's.
    They tracked where guys were looking and it was not at the product.
    In fact, they frequently didn't remember the product.
    Very popular commercial of a girl exiting the water in a little suit holding a can of pepsi.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  15. And after that... by Nerdposeur · · Score: 4, Funny

    Yes, and eventually they'll create a console that can read your intentions without any conscious effort on your part at all - all you have to do is exist.

    This console will be called the Bii.

  16. Re:Eye tracking is dumb. by theaceoffire · · Score: 3, Insightful

    Imagine this:
    When you focus on something, more info about it slowly appears.

    Either it becomes more detailed then the suroundings, or details like health, stamina, or whatever.

    It could be quite impressive.

    --
    I steal signatures. This one used to be yours.
  17. just like STNG.. by Tominva1045 · · Score: 2, Funny

    Dude, this is exactly how they almost took over the Enterprise that one time when Wesely came home from the Academy on vacation. I wouldn't trust it.

    --
    Cogito Ergo Sum
  18. Why should it be used as a pointing device? by Brandano · · Score: 3, Insightful

    Imagine using this feature to render highly detailed 3D images only where the user is actually looking. The peripheral vision is almost useless, the actual area that does most of the seeing is in the center of the retina. The brain fills in the blanks and keeps a mental image of what you are seeing that gets updated through rpid eye movement. With a smart setup this could be translated in a huge screen that appears to have a large resolution in every direction while keeping the processing power requirements still accessible. The mouse is a great interface, I don't see any reason to replace that just yet.

  19. Looks still can't kill .. by Ihlosi · · Score: 2, Funny

    ... but soon, they can frag.