Slashdot Mirror


What Will Apple Do With Swedish Eye-Tracking Technology?

andylim writes "An article on recombu.com explores the possibility that Apple is gearing up to launch eye-tracking technology soon. Citing a patent filed in 2008 that mentions 'gaze vectors' and a recent purchase of units from a Swedish eye-tracking company, the author suggests that the inclusion of eye-tracking tech in the company's forthcoming tablet would be Jobs's magnum opus. 'What better flourish to a career that began with the popularization of windows, icons, mouse and pointer than to usurp them all?'"

34 of 170 comments (clear)

  1. the Eye-pod? by Em+Emalb · · Score: 5, Funny

    Too soon?

    --
    Sent from your iPad.
    1. Re:the Eye-pod? by swanzilla · · Score: 2, Funny

      Too soon?

      iConcur

    2. Re:the Eye-pod? by icebike · · Score: 2, Informative

      Not only too soon but too expensive.

      Tobii (the Swedish company in question) has products that start at $7500 bucks per unit.
      http://www.tobii.com/corporate/eye_tracking/our_technology.aspx

      Further, all of their devices require custom installations.
      http://www.tobii.com/market_research_usability/products_services/eye_tracking_hardware/tobii_x120_eye_tracker.aspx

      Although they claim it works with eyeglasses in the real world that does not work due to the narrow range of tints and prescriptions that can be handled.

      --
      Sig Battery depleted. Reverting to safe mode.
    3. Re:the Eye-pod? by fuzzyfuzzyfungus · · Score: 2, Interesting

      These worthless wastes of life are already busy applying the idea to advertising. Who wouldn't want a billboard watching them?

  2. Swedish Eye-Tracking by RealErmine · · Score: 3, Funny

    I'm not Swedish. Am I immune to this technology?

    --
    Dewey, you fool! Your decimal system has played right into my hands!
    1. Re:Swedish Eye-Tracking by mcgrew · · Score: 2, Informative

      Eye tracking has been used for useability studies for quite some time. http://www.useit.com/alertbox/

      don't woosh me, bro...

  3. Give me my computer glasses? by Drethon · · Score: 3, Insightful

    Not sure if this technology would apply to it but I've always wanted a computer with main unit, say the size of a cell phone, wired to a set of LCD glasses (preferably transparent so you could see whats going on around you while using it). Then you could navigate with voice commands, gestures and eye movements.

    Though with multi-touch coming these days you could have multiple mouse icons and use eye movement and mouse movement on the same computer or instead eliminate the mouse and never have to take your hands off the keyboard to navigate (yes some of us use computers for more than porn).

    Just my $0.02

    1. Re:Give me my computer glasses? by bnenning · · Score: 2, Insightful

      People can't even drive straight while TALKING on a cell phone.

      Certainly you wouldn't use it while driving, and even walking might take some practice. But if you're not moving, having the display on glasses is a huge improvement over both laptops and phone displays.

      Not to mention the difficulty some of us have on focusing on a screen that close.

      Nobody can, but my understanding is that they can create an image that appears clearly even though you aren't directly focused on it.

      --
      How to solve most of our problems: 1.Lots of nuclear plants. 2.Cure aging.
    2. Re:Give me my computer glasses? by Rockoon · · Score: 2, Interesting

      wired to a set of LCD glasses

      Are you still young enough to focus on things less than an inch from your eye? I suggest that you actually try it. You'll probably be surprised that you can't. This technology would have been here a decade ago if there was a mass market for it. There isn't.

      --
      "His name was James Damore."
  4. I don't think he gets it by Monkeedude1212 · · Score: 5, Insightful

    'What better flourish to a career that began with the popularisation of windows, icons, mouse and pointer than to usurp them all?'"

    Eye tracking technology doesn't usurp ANY of that. If anything, eyetracking technology makes windows and icons more useful, since those are designed to hold your attention for the short span that you need them.

    And don't think that this technology would ever replace the mouse. You need a mouse for gaming, amongst many things. One such annoying technology around today is rollover ads. Our eyes often make tiny glances at colours and items that grab our attention.

    Point is, they aren't changing the existing system, merely adding onto it.

    1. Re:I don't think he gets it by Princeofcups · · Score: 2, Insightful

      And don't think that this technology would ever replace the mouse.

      You never played Doom did you? I believe the quote was that no one would use a mouse because using the keyboard is so much better. Games adapt to the input devices available to them, and the mouse, at some point will be history. Don't say never. It's never true. :-)

      --
      The only thing worse than a Democrat is a Republican.
    2. Re:I don't think he gets it by Monkeedude1212 · · Score: 2, Insightful

      I don't disagree the mouse will disappear, just that Eye-tracking won't be the thing to do it. I believe Multi-touch will be, go google some of Jeff Hans videos (or look it up on TED.com) and you will see some amazing applicatons he's made with Touch Screens, or even sophistaced smart boards and projection techniques using relatively affordable hardware.

      I just watched this and I agree - even the keyboard will probably be phased out once accurate Touch screen technology gets better amongst the big players. The great thing about all of Jeff Hans' items is that they are Open Source, if I put the money down for the hardware* I can duplicate EVERYTHING he demos, even contribute to his projects.

      I might fire off an email and just ask him if he has any research going on with Eye tracking technology, and if he does, how much it would cost to set something like that up.

      I think ultimately by the time I reach 80, some of the tech in Minority Report should be existant. We will have cool interfaces that change with multiple inputs from the user. And that Ads can essentially read my retinas from far away, and annoy the hell out of me.

      *In fact, the first video of his that I saw he was demoing how a Wiimote and an Infra red Diode (Approximately 50 dollars) could produce a smart board (several hundred dollars). I am still considering doing this with just to play around with it.

    3. Re:I don't think he gets it by smidget2k4 · · Score: 4, Insightful

      Nintendo might beg to differ...

    4. Re:I don't think he gets it by bill_mcgonigle · · Score: 2, Interesting

      Point is, they aren't changing the existing system, merely adding onto it.

      Right, I think I've posted here before wishing for a system that allows you to switch window focus with eye tracking - especially useful in a multi-monitor setup (I always get hosed up with that).

      But $7500 gear isn't the way to do this. Stereo cheap-ass CMOS 'webcam' sensors on the sides of the monitor and a whole bunch of GPU number crunching should do the work just fine (and also get us video conferencing where you can look at the 'center' of the screen (through still more processing) without really having to put any cameras into the screen.

      Cheap hardware + massive image processing seems to be winning nearly every fight.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    5. Re:I don't think he gets it by maxume · · Score: 2, Insightful

      Those screens are great, but they depend on having an IR camera pointed at the whole back of the screen, which means that they aren't getting thin very fast.

      --
      Nerd rage is the funniest rage.
  5. Not Apple-like by Darkness404 · · Score: 2, Insightful

    I don't really think that Apple will use eye tracking... yet. Why? Because there aren't enough existing products out there. The vast majority of Apple's products show up when there are 1 or 2 other early products out there that Apple can improve on. Eye-tracking isn't used in any major way yet and so I don't think Apple will use it quite yet.

    --
    Taxation is legalized theft, no more, no less.
  6. Eye-tracking is a tricky subject by clone53421 · · Score: 4, Interesting

    There are two main problems with eye tracking. First, your eyes are always moving. Second, they’re attracted to motion.

    Eye tracking, done correctly, would have to avoid both of these pitfalls. It would be possible, but tricky. It would have to differentiate between the constant motion of your eyes and deliberate motions that you wanted to make, or at least not be adversely affected by all of their unconscious movements. It would also need to avoid causing movement or changes on the screen that would draw your attention away from what you intended to look at.

    For instance, if a normal cursor was displayed at the detected position of your gaze, it would (A) obscure, (B) distract, and (C) float irritatingly away from your gaze if its positioning was even slightly miscalibrated.

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
    1. Re:Eye-tracking is a tricky subject by symes · · Score: 2, Interesting

      This is very true - however our eye gaze is also attracted to things we find interesting. An interface that had that information could easily rearrange itself based upon where we were looking. For example, you could imagine a 4 by 4 grid, each cell linked to some app or document. the size of each cell would be in proportion to the time spent gazing at it... and as cell size increases different components/layers of information for each cell becomes visible. I'm sure the people of Apple could come up with something a little more tasty than that example, it's just an idea.

    2. Re:Eye-tracking is a tricky subject by querist · · Score: 2, Funny

      To respond to your second point, and to agree with it...

      SQUIRREL!

      (If you don't get it, see the movie "Up!")

    3. Re:Eye-tracking is a tricky subject by Gilmoure · · Score: 2, Funny

      Man, I HATE squirrels!

      --
      I drank what? -- Socrates
  7. Why not autofocus applications by beefnog · · Score: 2, Interesting

    It always seemed to me that the greatest benefit of tracking the position / geometry of a user's eyes would be for determining their focal point. The user will look at your information directly if it's needed, but if it was always in focus they will be less fatigued by constantly changing focal points. In handheld devices this would allow you to glance at your phone by bringing into your field of view without having to take your focus off the road / sidewalk. Refining the technology enough that people could use computers at work without having to have corrective lenses on / in would do wonders.

  8. You know what I've always wanted? by royallthefourth · · Score: 4, Insightful

    I hate it when I look at a field and start typing only to find out that something else has focus. This happens to me in every GUI I've ever used and if a webcam with gaze vectoring can fix that I'd really like it.

    1. Re:You know what I've always wanted? by Anonymous Coward · · Score: 5, Funny

      Yeah, clearly something stole the focus and changed your font to retarded.

  9. The answer is obvious, really... by Tetsujin · · Score: 4, Funny

    I mean, what else would you do with Swedish Eye-Tracking technology? Track Swedish Eyes, obviously...

    --
    Bow-ties are cool.
  10. apple + tablet + eye tracking = !(kindle) by dijjnn · · Score: 2, Interesting

    They're going to build an ebook reader app for their rumored tablet to kill the kindle & dominate the market. as Ramanujan once said for a famous one line proof, "Behold."

    --
    ~dijjnn
  11. Videoconferencing by Dracker · · Score: 4, Insightful

    One of the big challenges in videoconferencing is the illusion that the subject, who is looking at your face on the screen, appears as if he or she isn't making eye contact with you, as the camera is not located in the middle of the screen. While this may seem minor at first glance (ha ha), it's actually a pretty important issue in videoconferencing, with significant demand for software that corrects it.

    A "gaze vector" is exactly the kind of information software would need to "correct" the illusion, to make it seem like the subject does have eye contact. I bet Apple is going to incorporate eye contact correction tech for videoconferencing in its products.

  12. Shall we buy these gadgets at Eye-Kea? by OmniGeek · · Score: 3, Funny

    Eye-eye, sir!

    --

    "My strength is as the strength of ten men, for I am wired to the eyeballs on espresso."
  13. Hm. Their eyetrackers are not that good. by Anonymous Coward · · Score: 5, Interesting

    Full disclosure: I am a vision researcher who has worked with most of the available eyetracking systems on the market.

    I had not heard of the company, and a quick look at their product line tells me why not: their standalone systems are limited to 60hz/120hz depending on the model - this was good several years ago, but has been considerably eclipsed by other companies' designs (e.g. S-R Research's Eyelink hardware, which happily does 2000hz monocular tracking). It looks on par with ASL's Eye-trac gear, which has similar limitations.

    I would bet that Apple just bought a few of their systems to use in internal testing - I sincerely doubt that anyone there is using such slow gear for major research.

  14. I guess you could say it would be... by HForN · · Score: 2, Funny

    An eye for an i.

  15. Hardware solution patented too...by Apple by sznupi · · Score: 3, Interesting

    There was a story some time ago about Apple patenting small, "hidden" in the screen cameras as a means of correcting eye contact issue that exists currently in videoconferences.

    Which really strikes me as another example of why patent system is badly broken in the US. Even I toyed some time ago with an idea of using small sensor / optical arrangement that minimizes size of the "camera", visible obstruction, so it can be placed in front of the screen without being too irritating. Hiding it between the pixels of LCD screen, when you have good enough manufacturing, seems to be just...a straightforward progression.

    --
    One that hath name thou can not otter
    1. Re:Hardware solution patented too...by Apple by MobileTatsu-NJG · · Score: 2, Insightful

      Hiding it between the pixels of LCD screen, when you have good enough manufacturing, seems to be
      just...a straightforward progression.

      Well, yeah, if you over-simplify any given proposal ("Make a camera small enough to fit between the pixels on a screen!") anything can seem like a straightforward progression. "Once a CPU is powerful enough, making an android is a straightforward progression!"

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

  16. insensitive clods! by xch13fx · · Score: 2, Insightful

    I have a lazy eye =(

  17. Just see it off by a little bit... by gsgriffin · · Score: 2, Funny

    I can imagine how the pointer moving ever so slightly away from where you are looking causes you to try to move your focus to where the cursor now is causing a cascading effect of chasing the cursor that is just out of focus and moving. It will eventually cause us all to have spastic eye movements constantly circling the page. That will be fun!

    --
    jsut athnoer menagiensls ltitle psrhae for you to dcoede. Why do we wtsae our tmie dnoig tihs?
  18. That has never stopped them by gsgriffin · · Score: 2, Informative

    The iPhone has multi-gesture apps because Apple first came to the broad market with such a device. People will build software to what hardware manufacturers make popular, ont the other way around.

    --
    jsut athnoer menagiensls ltitle psrhae for you to dcoede. Why do we wtsae our tmie dnoig tihs?