Slashdot Mirror


Lens-Free Flat Cameras Make Use of Pinhole Technology (npr.org)

RhubarbPye writes: As reported on NPR, "Engineers in Texas are building a camera that can make a sharp image with no lens at all." By incorporating millions of individual pinholes with photoreceptors and postprocessing software, this camera system has been reduced to minimal thickness. Cameras in the wallpaper? A new phase of wearable cameras? What other applications for this technology could be developed?

65 comments

  1. I want to put my money into a hole by penguinoid · · Score: 1

    Looks like someone decided to put their money into a hole.

    --
    Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    1. Re:I want to put my money into a hole by Anonymous Coward · · Score: 0

      Cameras in the wallpaper? A new phase of wearable cameras? What other applications for this technology could be developed?

      You got too much imagination. This will only be use for thinner iPhone++.

    2. Re:I want to put my money into a hole by shanen · · Score: 1

      I was looking for the "Nothing to see here" joke.

      Who is responsible for this hideous omission?

      On a more serious note, the headline was rather sensationalistic. My first thought was "pinhole", but perhaps I know too much about the history of optics and photography?

      --
      Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
  2. Paranoids will freak at this by Anonymous Coward · · Score: 0

    Poor sufferers of paranoid conditions, will freak at this. Now their wallpaper might be spying on them...

    1. Re:Paranoids will freak at this by fustakrakich · · Score: 1

      Yes

      --
      “He’s not deformed, he’s just drunk!”
  3. The Erin Andrews Lens by Anonymous Coward · · Score: 0

    A/J/A peepshow lens, is nothing to sneeze at.

  4. Re:I must be missing something... by Frosty+Piss · · Score: 3, Informative

    So, let's see if I get this right. They rediscovered something, that everyone from the 1990's and 80 years prior learned to make as part of science class...and simply applied modern technology to it.

    No, you didn't get it right. But that's not surprising, clearly you didn't read the article.

    --
    If you want news from today, you have to come back tomorrow.
  5. Re: I must be missing something... by Anonymous Coward · · Score: 1

    This technology has many holes. It looks like there is no limit of how many holes you can have. I would imagine that with enough holes you get super accurate photos from space. And most likely it will be much cheaper.

  6. Dynamic range? by RightwingNutjob · · Score: 4, Insightful

    TL;DR. Most uncooled camera chips give you maybe 10 or 11 bits of dynamic range, and light is subject to Poisson noise, meaning the brighter a pixel, the noiser it is in absolute (not relative) terms. If you have to solve a big giant matrix inversion to do the job of a collimating lens, you're composing each pixel as a sum of many others instead of just itself, some of them being way brighter than the reconstructed image, meaning your reconstructed pixel is always noisier. Cool idea, and certainly has its applications, but the best images will always come from big fat optics.

    1. Re:Dynamic range? by Arkh89 · · Score: 4, Insightful

      No. First, on these you are mostly limited by the thermal noise of the sensor which is miles above the photon noise for this application. Then you are still thinking that a pixel receives the same flux (power per surface area) as a traditional camera. This is not correct as each of the pixels collect flux from a much larger angular portion of the scene (due to the lack of optical focusing).

    2. Re:Dynamic range? by Ungrounded+Lightning · · Score: 4, Informative

      If you have to solve a big giant matrix inversion to do the job of a collimating lens, you're composing each pixel as a sum of many others instead of just itself, some of them being way brighter than the reconstructed image, meaning your reconstructed pixel is always noisier.

      Not really.

      When you average a large number of samples the noise tends to partially cancel out while the signal keeps adding up. Though the noise goes up with more samples, the signal goes up more, improving the signal to noise ratio. Even if you end up adding in some bright signals, with extra noise, that's still stomped by signal when you have enough samples.

      --
      Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
    3. Re:Dynamic range? by Anonymous Coward · · Score: 3, Informative

      No, the original poster was more correct. They're not averaging together a bunch of pixels, but applying an inverse matrix , which will weigh pixels differently, and quite frequently can involve very high weights assigned to noisier signals. This can result in an emphasis that amplifies noise. There is a lot of work done on different ways of clipping or modifying such matrix equations to make it slightly less accurate in an ideal world, but much less noisy in the real world.

      Also, no averaging of noise will happen if you try to produce images with similar pixel count to the number of detectors. And if you do use more sensors than resulting pixels, the averaging increases signal to noise ratio only in general when the noise is independent, but in this case there will be some strong correlations that can lower that signal to noise ratio in some cases.

    4. Re:Dynamic range? by goombah99 · · Score: 1

      No. As someone with patents on multiplex imaging, I can tell you that inverse problems lead to greater noise or equivalently reduced dynamic range. You can see this in their photos.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    5. Re:Dynamic range? by Ungrounded+Lightning · · Score: 1

      Also, no averaging of noise will happen if you try to produce images with similar pixel count to the number of detectors.

      I agree completely there. (I'd say there is averaging but you're averaging in as much extra noise from other pixels as you're averaging out from multiple samples of the target pixel - and even if the noise were merely proportional the pixel brightness, rather than disproportionate as they get brighter, the bright ones would noise up the dim ones.)

      They're not averaging together a bunch of pixels, but applying an inverse matrix , which will weigh pixels differently, and quite frequently can involve very high weights assigned to noisier signals. This can result in an emphasis that amplifies noise.

      And that sounds reasonable so I'll defer to your expertise.

      --
      Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  7. Re:I must be missing something... by gl4ss · · Score: 3, Interesting

    I suspect that if you put a lens on it, you would end up with a light field camera.

    aaaaanyways... this is wikipedia on light field camera: "A light field camera, also known as plenoptic camera, captures information about the intensity of light in a scene, and also captures information about the direction that the light rays are traveling in space. One type of light field camera uses an array of micro-lenses placed in front of an otherwise conventional image sensor to sense intensity, color, and directional information. Multi-camera arrays are another type of light field camera. Holograms are a type of film-based light field image."

    which sounds almost exactly like a variation of this. it's the same exact concept.

    --
    world was created 5 seconds before this post as it is.
  8. Re:GNAA - we want to FUCK that pinhole with GAY DI by Anonymous Coward · · Score: 0

    Seriously, you need to get some help.
    Obviously you are scared of your feelings for members of the same sex, you should get some help in accepting this and you may find a path to a happier lifestyle.
    It seems you also suffer fear from the feelings of attraction you have for people of different races. Embrace these feelings, they will also lead you to a more comfortable and fulfilling relationship one day.

  9. Millions of pinholes * near zero size = ?? by erice · · Score: 2

    Nothing in the article talks about what the resulting aperture is. To get a reasonable exposure time, you need to capture adequate light. Cameras in cell phones already suffer because their lenses are too small to capture enough light. Is this scheme worse because it lets less light through or better because a larger "lens" is practical?

    1. Re:Millions of pinholes * near zero size = ?? by Anonymous Coward · · Score: 0

      Aperture is not a finite value but the ration between sensor (film) and lens opening.
      In this case they use tiny pixels with tiny pinholes, remember there is no intend or even ability to focus on a single pixel so maximum aperture is possible.

      --
      Teun

  10. Neat idea. by Anonymous Coward · · Score: 0

    But based on the blurry, grainy photos they have taken with it so far, i am not terribly impressed. Add a few MM of thickness onto it, and a modern cellphone camera can take photos miles better than that thing. (without the costly computations as well)

  11. What would be interesting... by kyubre · · Score: 1

    What would be interesting is if such a sensor array could efficiently and wirelessly tether itself to the image processing engine. The potential surveillance applications are mind boggling.

    --
    Nothing evolves faster than the word of god in the minds of men who think themselves divinely inspired.
  12. Camera in your tv by Anonymous Coward · · Score: 0

    Combine your vdu and a camera and you have a much better Skype/spying device.

    1. Re:Camera in your tv by dsmatthews9379 · · Score: 1

      Yeah I think Apple already have a patent on that.

  13. Lytro beat them by 10 years by Anonymous Coward · · Score: 0

    with the same principle.
    Except having a lens reducing the amount of holes significantly.

  14. Seems like a good idea. by kimgkimg · · Score: 1

    Generally a pinhole camera is very light insensitive due to the small amount of light let in by the pinhole, but multiply the number of pinholes to amplify the image and use a super sensitive sensor gathering from each pinhole, and it seems like it would yield some amazing results.

  15. Re:I must be missing something... by Arkh89 · · Score: 1
  16. The Irony by djinn6 · · Score: 2, Funny

    I see all of the photos in the article were taken with a conventional camera, complete with lens blur.

  17. Stereo vision by Anonymous Coward · · Score: 0

    First application before useless wallpaper camera should be dual camera vision system as stereo matching with lens-less camera should be easier.

  18. Re:I must be missing something... by shanen · · Score: 3, Insightful

    Actually it's more like the compound eye of insects, but 'wired' differently.

    --
    Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
  19. VR is the hot new thing by fragMasterFlash · · Score: 2

    So make a headband 360 degree camera to capture video you can view with your VR headset. Also, make police officers wear these instead of the silly badgecams they currently use.

  20. Your next webcam by ntropia · · Score: 1

    ...will be your screen. In a video call you will be able to look at the other party in his/her eyes and it will not appear like you're reading something else.

    1. Re:Your next webcam by Holi · · Score: 1

      So like the tv's in 1984?

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
  21. Nothing is new under the sun? by Lluc · · Score: 4, Interesting
    The way the NPR article describes this, it is no different from Uniformly Redundant Arrays, i.e. Coded Aperture Imaging: see https://en.wikipedia.org/wiki/... If you look at the 1998 paper, "Uniformly Redundant Arrays" by Busboom et al, the first sentence describes work from the 1960s:

    Coded aperture imaging (CAI) (Mertz and Young, 1961; Dicke, 1968) has matured as a standard imaging technique in X–ray and Gamma-ray astronomy. It is capable of combining high angular resolution with good photon collection efficiency by using a mask consisting of transparent and opaque elements placed in front of a position sensitive detector (Figure 1).

    So is the only innovation here using more pinholes, more pixels, and more processing than were around in the 1990s?

    1. Re: Nothing is new under the sun? by Anonymous Coward · · Score: 0

      Yeah, reminds me of sparse imaging / compressive sensing too. Nothing new here except perhaps they aim for a consumer product. I would still welcome any device capable of imaging at high resolution and wide dynamic range without a lens. Lenses are so medieval, we should do better.

    2. Re: Nothing is new under the sun? by Lluc · · Score: 2

      Yeah, reminds me of sparse imaging / compressive sensing too. Nothing new here except perhaps they aim for a consumer product. I would still welcome any device capable of imaging at high resolution and wide dynamic range without a lens. Lenses are so medieval, we should do better.

      As their paper points out, these pinhole systems really suffer from the fact the the imaging aperture is TINY. This produces a low resolution, high depth of field image like a camera with a very "high / slow" F/# .
      High degrees of multiplexing also require high bit depth measurements and low noise, driving sensor cost up.

    3. Re:Nothing is new under the sun? by nickersonm · · Score: 1
      Given that the paper is titled FlatCam: Thin, Bare-Sensor Cameras using Coded Aperture and Computation, I think they know about the previous work. Specifically,

      FlatCam is an instance of a coded aperture imaging system; however, unlike the vast majority of related work, we place the coded mask extremely close to the image sensor that can enable a thin system.

    4. Re:Nothing is new under the sun? by goombah99 · · Score: 1

      It's the flatness and the lateral extensibility (wall paper sized) that are new for coded aperatures

      --
      Some drink at the fountain of knowledge. Others just gargle.
  22. Re: I must be missing something... by Anonymous Coward · · Score: 0

    Cameras like this don't let you overcome the diffraction limit for a given overall detector size.

  23. Re:I must be missing something... by lindseyp · · Score: 1

    I think the "micro mask" is the lens array. It already is a light-field camera.

    I can't wait to see what these things start to be capable of as technology progresses to assemble the micro structure and we get over the computational overhead

    --
    j'ai découvert une démonstration vraiment admirable (de ce théorème général) que cette si
  24. Re:GNAA - we want to FUCK that pinhole with GAY DI by Anonymous Coward · · Score: 0

    BAN THIS TROLL AND ITS IP ADDRESS
    this is worse than anything APK posted

  25. Scalable by DrYak · · Score: 2

    Is this scheme worse because it lets less light through or better because a larger "lens" is practical?

    Currently, it's worse (TFA mentions quality similar to first gen webcams).
    But indeed, that technology is really scalable. TFA muses with large surface flatcams.
    (They mention walls of it. Or boxes/cylinder in the middle of which you put an object, etc.)

    So the whole back cover of a smart-phone could be a giant pinhole array.
    Such a large surface even if covered with only pinholes (and even if some of the hole might get obscured by fingers holding the phone) would gather much more light and information and could produce better image. Exactly as you say : "a practical larger len" but taken to the extreme

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  26. Massively parallel pinhole camera by DrYak · · Score: 2

    So, let's see if I get this right. They rediscovered something, that everyone from the 1990's and 80 years prior learned to make as part of science class...and simply applied modern technology to it.

    No, you didn't get it right. But that's not surprising, clearly you didn't read the article.

    What? Even TFA itself mentions that the researcher decided to go back to the classical pinholes as inspiration:

    To design their camera, Baraniuk and his colleagues looked to the past for inspiration.

    "Back to really the very first cameras, pinhole cameras," Baraniuk says.

    Pinhole cameras have been here for quite a while. According to some scholars, they were first described by the Chinese philosopher Mo Ti around 400 B.C

    Basically they've taken the pinhole camera, and decided "We have computing power !"
    Instead of putting just one camera (which would definitely NOT gather enough light at this size), they're massively parallelized it. They've put millions of pinholes camera on the chip and are using post processing to reconstruct the final image out of the tons of tiny pinhole views.

    In away their doing exactly what light field photography does, except sans the micro-lens array usually associated with the technology. They've put a pinhole mask instead.

    But the parent poster is right, the research have decided to take a well known old trick (the century old pinhole camera) and put a new spin to it (apply tons of computing, thus using tons of pinholes in massive parallelism, enabling to do something like light-field photography, but with no lens at all).

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
    1. Re:Massively parallel pinhole camera by stevelinton · · Score: 2

      Instead of putting just one camera (which would definitely NOT gather enough light at this size), they're massively parallelized it. They've put millions of pinholes camera on the chip and are using post processing to reconstruct the final image out of the tons of tiny pinhole views.

      I think there are more pinholes of a variety of different shapes, and fewer sensor pixels than your description might suggest.

  27. Re:I must be missing something... by Mashiki · · Score: 1

    TFA:

    To design their camera, Baraniuk and his colleagues looked to the past for inspiration.

    "Back to really the very first cameras, pinhole cameras," Baraniuk says.

    Pinhole cameras have been here for quite a while. According to some scholars, they were first described by the Chinese philosopher Mo Ti around 400 B.C

    No, you didn't get it right. But that's not surprising, clearly you didn't read the article.

    Apparently I did. How the hell your comment got to informative I have no clue.

    --
    Om, nomnomnom...
  28. The Fly... by Anonymous Coward · · Score: 0

    The Fly... Anyone?

    http://rdhorrorproject.blogspot.com.br/2010/10/film-44-fly-1958.html

  29. It will still be a bit bulky I guess by bytesex · · Score: 1

    I assume that you still have to make the surface with all the pinholes in, a little convex. If only to not just capture the same square cm in front of the lens a thousand times.

    --
    Religion is what happens when nature strikes and groupthink goes wrong.
    1. Re:It will still be a bit bulky I guess by geantvert · · Score: 2

      I don't think so. Each pinhole can produce an image corresponding to a wide angle which only depends of the size of sensor of its distance from the pinhole. If the sensor is very close to the pinhole(s) then the image will have a wide angle (up to 180 degrees).

       

  30. Re:I must be missing something... by dave420 · · Score: 1

    They didn't rediscover it. They knew about it all along, but figured out a way to actually make it useful in this application. So your claim was incorrect.

  31. Re:I must be missing something... by 91degrees · · Score: 2

    No. They applied new technology to something they already knew about.

    A pinhole camera is educationally interesting but not much use for practical purposes. You simply don't get enough light coming though. It's easily solved by optics. Most cameras use a lens to squeeze more light through the aperture. But this requires a certain thickness. Not a problem if you can afford a few CM of thickness, but unsuitable for flat cameras.

    You can also solve the problem by using lots of pinholes. But if you use a single CCD, you get interference from lots of similar but different images. So you need to use some pretty sophisticated computer processing to unmerge these images.

  32. wow by Anonymous Coward · · Score: 0

    ShashDot goes to S@$@% lately, what is happening with this site?

  33. Re: GNAA - we want to FUCK that pinhole with GAY D by Anonymous Coward · · Score: 0

    What is this stuff? It's hard to read on a mobile browser, it shows everything..
      Hey op you have an issue with African Americans?

  34. Re:I must be missing something... by BarbaraHudson · · Score: 1

    Actually, I remember reading this in a dead-tree scientific american in the (irc) 70s. After reading TFA, it's exactly the same thing. Hope they don't get a patent on it :-)

    --
    "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
  35. Re:I must be missing something... by BarbaraHudson · · Score: 2

    A pinhole camera is more than adequate for taking pictures of eclipses of the sun, etc. It's also good enough for taking stills (longer exposure time) or objects lit with a very bright light (like a flash, maybe?).

    --
    "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
  36. Re:I must be missing something... by Mashiki · · Score: 1

    To design their camera, Baraniuk and his colleagues looked to the past for inspiration.

    That's effectively rediscovering it.

    --
    Om, nomnomnom...
  37. Re:I must be missing something... by Anonymous Coward · · Score: 0

    So, nothing like it at all, then?

  38. Integral MicroOptics from the 1980's by eastjesus · · Score: 2

    Interesting work with a lot of unobvious possibilities. "Lensless" is a little misleading. Pinholes are just the center circle of a zone plate. Zone plates are lenses that work by diffraction instead of refraction. They look like a bulls-eye (see http://www.eastjesus.net/tech/... for a quick and simple primer). The diameter of the hole determines the focal length - hence too big OR too small leads to fuzzier images. The have a couple of big drawbacks - the focal length is a function of wavelength hence objects in the image have rainbow edges and the aperture of a focused pinhole is small (the f-stop). The effective f-stop can be increased at will by adding additional zones around the pinhole but zone plates that work by blocking areas can only achieve efficiencies of around 10%. That can be improved to around 90% or more by replacing the opaque zones with tapered phase-shifting zones. Back in the mid 1980's I worked with a similar technology using arrays of zone plates which we called Integral MicroOptics. We used arrays of micro-zone plates (and pinholes) to capture image data over large sheets (hence from many angles at once) and then reconstruct that data with full parallax in 3D and color, both stored and in real time and sometimes with some optical computing applied - all using passive devices! They were the equivalent of full color holograms using a subtractive technology instead of an additive one, hence no lasers were required and the more diffuse the light the better. It was amazing what could be done with thin flat sheets of plastic and printing but the technology of the day was too crude to get very far. Today much more could be achieved. If interested you can see the original paper from 1986 at http://www.eastjesus.net/tech/... (with updated graphics and a link to the original) and http://www.eastjesus.net/tech/... for some images created using the technology at that time.

  39. Re:I must be missing something... by ChrisMaple · · Score: 1

    Single pinhole cameras have severe quality limits. Make the hole too big and sharpness is inversely proportional to the diameter of the hole. Make the hole too small and sharpness is proportional to the size of the hole, and the amount of light is reduced also. For best sharpness there's an optimum pinhole diameter { 1.9 * sqrt ( f * l ), where f is focal length and l is wavelength }, and the results even at the optimum aren't very good.

    Multiple pinholes offers a theoretical way around the diffraction limit. If I understand the concept correctly, this is a "synthetic aperture" technique.

    --
    Contribute to civilization: ari.aynrand.org/donate
  40. Re:I must be missing something... by BarbaraHudson · · Score: 1

    and the results even at the optimum aren't very good.

    You might be surprised if you do an image search for "photos taken with a pinhole camera."

    --
    "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
  41. Re:I must be missing something... by 91degrees · · Score: 1

    They're stylistically interesting, but don't have constant brightness across the image and have some pretty quirky distortion; which I appreciate looks good, but is usually the sort of thing photographers want to avoid.