Slashdot Mirror


Augmented Reality In a Contact Lens

Toe, The writes "Bionanotechnology researcher Babak A Parviz writes about his research toward producing a computer interface in a contact lens. At the moment, they have only embedded a single LED, but they foresee a much more complex interface such as detailed in Vernor Vinge's Rainbows End. Such lenses potentially could also read human bio-information from the eye, providing medical information on the order of what is now taken from blood tests, but on a continuous basis. An example would be monitoring glucose levels for diabetics. The author states that, 'All the basic technologies needed to build functional contact lenses are in place,' and details what refinements and advances will be necessary to bring this technology to reality."

35 of 196 comments (clear)

  1. Cool by SilverHatHacker · · Score: 3, Funny

    This is way better than having to hold your iPhone in front of you all the time...

    --
    Funny may not give karma, but +5 Informative never made anyone snort coffee out their nose.
    1. Re:Cool by Yvan256 · · Score: 2, Funny
    2. Re:Cool by blackraven14250 · · Score: 2, Insightful

      Implants are impractical for everyone to have. There's too much of a failure rate in all electronics, and the moment you have a dead pixel, I pity you. If someone doesn't like it, or needs an upgrade, you're screwed. Like the fact that they doubled the resolution since you got it? Too bad, your eye can't handle another surgery. Augmented reality belongs as just that: an augment, as in a set of glasses you can take off. There's no place in the human body for an upgrade slot.

  2. A 21st Century Contact Lens by davide+marney · · Score: 5, Informative

    Here's an illustration that explains it all in a glance.

    --
    "We receive as friendly that which agrees with, we resist with dislike that which opposes us" - Faraday
    1. Re:A 21st Century Contact Lens by phayes · · Score: 2, Interesting

      I suppose that the micro-lenses focus the output of a LED directly on the retina but do not see how LCD type displays referred to in TFS can work. Anyone?

      The problem for those who have not realized it is that LCDs in contact lenses are too close to the eye to work. They would subtract some light but be invisible much like a screen is when you put your face up to it & focus outside.

      --
      Democracy is a sheep and two wolves deciding what to have for lunch. Freedom is a well armed sheep contesting the issue
    2. Re:A 21st Century Contact Lens by Oewyn · · Score: 2, Funny

      Upon looking at the picture I have discovered a fatal flaw in the design.

      Solar cells.

      I could just see the warning on the HUD now:

      "WARNING, battery low, please look directly at the sun to recharge capacity."

  3. yes! by Mr.Fork · · Score: 3, Interesting

    Now, throw in a TrackIR-like system, and we can 100% totally immerse ourselves inside a virtual reality PC. No more monitors that have limited field of views etc. Also, imagine the military and civilian aspects - how a terminator can overlay regional information like that of the new iPhone app - but now it's in your eyes.

    But they're gonna have to figure out a) how to power it and b) how to transmit the data to these devices. That is true tech challenge.

    --
    Management is doing things right; leadership is doing the right things. - Peter F. Drucker
    1. Re:yes! by Anonymous Coward · · Score: 4, Funny

      Just imagine being able to watch porn while you're tagging that not-so-hot chick you met at the bar!

    2. Re:yes! by Fallingcow · · Score: 2, Interesting

      No no no no no

      It'll be used to present a VR overlay ("skin") on your generic sex-bot, which will be printed with a pattern that the lenses can easily recognize so it can correctly orient the 3-D model. Get bored with the Angelina Jolie skin? Fick your eyes to the side to cycle forward to the Cindy Crawford skin in mid-stroke!

      Holy shit, I think I need to patent that...

    3. Re:yes! by mrrudge · · Score: 2, Funny

      Unfortunately by using Cindy Crawford as an example you've shown your age, and by the time this reaches the consumer you'll be using it to magically replace the petunia in your garden that the cat from next door ate. At least, I think it lives next door, I've seen it around there and, oh, no, that one has black feet. Or is it the one from up the road that has, what, Cindy who ?

  4. I have a request. by Anonymous Coward · · Score: 4, Funny

    Can I just get a contact lens with cross-hairs in it?

    Why yes. I do play Quake III Arena often. Why do you ask?

  5. Small steps. by palegray.net · · Score: 2, Insightful

    I'd be happy just to have a usable interface in a pair of normal glasses (non-correcting).

  6. Another inevitable function of this... by d474 · · Score: 4, Interesting

    Another inevitable function of this contact lens is recording video. Everything you see passes through this lens, so you will be able to record everything you see (except, of course, for dreams and hallucinations).

    It would be like Tivo for your life.

    --
    Authority questions you. Return the favor.
    1. Re:Another inevitable function of this... by Chyeld · · Score: 2, Insightful

      With respect, I doubt that'll be in the 'near' future for these. The problem with recording video is that you actually have to capture the photons to do that. Capture the photons on the recording media, and they are no longer available for the eye to 'see'. The non-contact versions of 'eye mounted' HUDs that I've seen get around this by using a complex setup to split the image into two, but from what I understand of that, it'd be practically impossible to use the same method for a contact.

      I suppose another solution might be 'capture and relay', but that invariably would cause your vision to lag reality. Not something I see even the most ardent transhumanists voting for.

    2. Re:Another inevitable function of this... by $RANDOMLUSER · · Score: 3, Insightful

      Further, studies show that the eye's point-of-focus jerks all over the place. Your gaze is rarely centered in just one spot in a scene. Then there's the question of (depth-of-field) focus...

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    3. Re:Another inevitable function of this... by Lord+Ender · · Score: 4, Insightful

      Contact lenses cover more than the pupil. A recording device located over the iris would not interfere with vision.

      --
      A slashdotter who didn't build his own computer is like a Jedi who didn't build his own lightsaber.
  7. Eye Fatigue, Ailments, Psychosis... by Xin+Jing · · Score: 2, Interesting

    My eyes get tired now from looking intently at a screen for hours each day, imagine the new ailments that can arise from such an invention! This reminds me of a Mad Magazine parody of the Six Million Dollar Man, where his targeting crosshairs blocked what he was looking at, begging the question - how do you turn it off? On the upside, you could browse the internet, send messages, play games and watch movies in perfect privacy. It could allow more taboo segments of the entertainment industry a legitimate platform. Videodrome anyone?

  8. A better suggestion for power: by jeffb+(2.718) · · Score: 4, Interesting

    Blinks. Leech kinetic energy from the eyelid. Teeny-tiny stick-on magnets go on the outside of your eyelid; they'll be the next fashion statement. Every time you blink, it induces a current pulse in the lens pickup coils.

    For that matter, it might be possible to collect energy from saccades and other natural eye movements. That's potentially a higher-res and lower-latency method for eye-tracking than cameras, which you'll need for AR, and if you can harvest energy to boot, so much the better!

    I don't have the physics/EE chops to run the numbers, but I'll bet you'd get more power this way than from a "solar cell module". (Who wants to keep their eyes wide open and directed toward a bright light source?)

    1. Re:A better suggestion for power: by Cedric+Tsui · · Score: 4, Interesting

      Or you could use burn glucose.
      the cells in the cornea are fed not by blood vessels (which wouldn't be transparent) but get their oxygen from the air, and their nutrients and sugars from your tears. The lens could do the same thing.

    2. Re:A better suggestion for power: by AmiMoJo · · Score: 2, Insightful

      Why not just replace the whole eye, or at least the lens part of it?

      Almost everyone over 50 has some vision issues, and many people much younger than that. Plus, you could add features like zoom or filters.

      That's the future - replacing parts of the body with better synthetic ones.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    3. Re:A better suggestion for power: by nahdude812 · · Score: 2, Informative

      They are definitely working hard on artificial sight. However it will be quite a while before artificial sight will be near as good as natural sight. Certainly I'm not an expert, but I do find the field fascinating. Slashdot user BWJones is one of the field's prominent researchers, working for the University of Utah.

      There's a number of things which prohibit us from being able to produce drop-in replacements for eyeballs. One of which, for example, is that the precise nature of the work that the retina does for us is not completely understood. There was some research about a year ago which showed that the retina itself is responsible for a large amount of the neurological processing we formerly thought occurred in the brain. Also it sends a number of distinct data channels to the brain. For example, one of the channels is edge detection, one is luminosity, one is motion detection, one is color, and so on. The exact nature of all of the data channels is not precisely understood, and at a minimum we need to understand that before we can do much meaningfully with providing a replacement signal.

  9. now anyone can be by FudRucker · · Score: 2, Funny

    The girl (or boy) with kaleidoscope eyes.

    --
    Politics is Treachery, Religion is Brainwashing
  10. There are lots of photons to go around. by jeffb+(2.718) · · Score: 2, Interesting

    Divert 10% of the incoming light to a recorder, and the wearer will never notice. Put the sensors on the outside face of some of the opaque lens components. Or put them around the periphery. There's no way you're going to do AR without a way to detect and analyze the "R" that you're "A"ing, anyhow.

  11. Why aug? by gEvil+(beta) · · Score: 2, Funny

    Why go for an augmented reality when you can have a demented reality?

    --
    This guy's the limit!
    1. Re:Why aug? by geekoid · · Score: 2, Funny

      trust me, most of augmented reality will be demented.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    2. Re:Why aug? by StreetStealth · · Score: 4, Insightful

      I thought what I'd do was, I'd pretend I was one of those deaf mutes!

      --
      Your mind is clear / The things that you fear / Will fade with how much you / Believe what you hear
  12. Science Reporting At Its Best by clt829 · · Score: 5, Interesting

    They've put a single LED in a contact lens, so now we have Augmented Reality.

    1. Re:Science Reporting At Its Best by $RANDOMLUSER · · Score: 3, Funny

      After they add the second LED to the contact lens, they'll have to figure out where to put the heatsink.

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  13. I've got all those! by autocracy · · Score: 2, Funny

    Hmm... Inertial Damper... *draws a huge arrow on his motorcycle schematic pointing to the front forks*

    Heinsenberg compensator = Registered ECC setup for RAM.

    Zero-point module: processor with no floating point instructions.

    --
    SIG: HUP
  14. I can't wait for the first hacker by Mishotaki · · Score: 3, Interesting

    I really can't wait for the first hacker who manages to hack someone else's lens to output an extremely bright light to the wearer...

    so that he has to remove those lens, because the natural reflex of closing the eye is totally useless!

    When you're arrested by the cops: "my lenses were hacked! i really didn't see that stop sign!"

    Or: "cause of death: blinded by his lenses while driving"

    Such an interesting future is coming towards us!

  15. Ghost in the Shell by jgtg32a · · Score: 2, Insightful

    I keep seeing people go on and on about Torchwood doing this, but this has always been a part of Ghost in the Shell, hopefully reality doesn't end up like GiTS because the "cyberbrains" make Win 95 seem secure.

  16. Cybernetic Eyes by Baron_Yam · · Score: 3, Interesting

    Forget a contact on my eye - replace the whole eyeball. Give me low light, infrared, light reduction, bloom compensation, microscope and telescope functions, facial recognition, recording, playback, computer display link, etc.

    Pretty much everyone needs glasses by 40 anyway, why not just get new eyes when you're 18?

    I know we're a long way off from being able to plug a camera directly into the optic nerve, but when that day comes I'm up for it.

  17. A on-eye web browser! It would take... by Anonymous Coward · · Score: 2, Funny

    ... goatse.cx to a whole new level.

  18. Further challenges by dewarrn1 · · Score: 4, Informative

    I love the idea, but having conducted many eye-tracking sessions I think that there are a number of basic challenges that the contact-lens implementation would need to overcome. First, contacts drift all over the cornea. It's really quite disconcerting to watch, especially when you've got obvious markers like vanity-coloring for irises. Station-keeping over the pupil would require technology that's not mentioned here. Alternatively, you might monitor the portion of the contact that's positioned over the pupil at any given moment using photocells on the underside to catch light reflected off the retina, but then you'll need a bigger display and use up valuable real estate. Second, similarly and perhaps even more importantly, orientation maintenance. If there was a good way for contact orientation to be maintained, bifocal contact lenses would be a reality already. Instead you encounter bizarre stopgaps like a reading lens in one eye and a distance lens in the other. Third, eyes are a fairly disgusting environment. Crud on regular contacts doesn't seem to impede vision, but the delicate electronics in a device like this might object to working in a wet, salty, bacteria-ridden setting unless very carefully insulated. Nothing bad about reaching for the dream, but I'll take a pair of prescription Virtual Light-style glasses while we're waiting.

  19. Vertical Stability and Durability by dlevitan · · Score: 2, Insightful

    One problem with this is that contact lenses float on your eye and are not stationary. This is a serious problem, because to keep a constant orientation, you'll either need to constantly rotate any light emitters to stay in the same place (probably not possible), or weight the contact lens as is currently done with astigmatic lenses (not a great solution).

    Apart from this, contact lenses tear, break, get lost, etc... At the moment, my soft lenses cost $5 apiece. If one tears, gets lost, or something else equally destructive, it's not a problem. If the same lens cost $1000, that would be a much bigger problem. And I'm not sure there's a good solution to this. If you make the lenses soft, they'll degrade quickly (as current soft lenses do). If you make them hard, then they will fall, get scratched, and the like over the long term.