Slashdot Mirror


Single Pixel Camera Takes Images Through Breast Tissue

KentuckyFC writes Single pixel cameras are currently turning photography on its head. They work by recording lots of exposures of a scene through a randomising media such as frosted glass. Although seemingly random, these exposures are correlated because the light all comes from the same scene. So its possible to number crunch the image data looking for this correlation and then use it to reassemble the original image. Physicists have been using this technique, called ghost imaging, for several years to make high resolution images, 3D photos and even 3D movies. Now one group has replaced the randomising medium with breast tissue from a chicken. They've then used the single pixel technique to take clear pictures of an object hidden inside the breast tissue. The potential for medical imaging is clear. Curiously, this technique has a long history dating back to the 19th century when Victorian doctors would look for testicular cancer by holding a candle behind the scrotum and looking for suspicious shadows. The new technique should be more comfortable.

17 of 81 comments (clear)

  1. more comfortable, but less fun by Trepidity · · Score: 5, Funny

    Some people pay good money to have a candle held behind their scrotum.

  2. Not Human Breasts...Doh by cb88 · · Score: 3, Insightful

    Its chicken breast tissue.... thats just blatant click bait. However you want to look at it.

    1. Re:Not Human Breasts...Doh by 93+Escort+Wagon · · Score: 5, Funny

      Its chicken breast tissue.... thats just blatant click bait. However you want to look at it.

      Or it might be chick bait.

      Thank you! I'll be here all week!

      --
      #DeleteChrome
    2. Re:Not Human Breasts...Doh by the_povinator · · Score: 3, Informative

      It's not really correct to say "breast tissue". Chickens don't have mammary glands, so they have no breast tissue as such. What I imagine they used is the pectoral muscle of the chicken, known for culinary purposes as "chicken breast".

      --
      The .sig is dead, and I believe I had a hand in killing it.
  3. Not a camera by graphius · · Score: 4, Interesting

    Not really a single pixel camera, more of a single pixel light absorption meter taken over an area...

    1. Re:Not a camera by donaggie03 · · Score: 4, Informative

      Not really a single pixel camera, more of a single pixel light absorption meter taken over an area...

      What is a camera if not a glorified light absorption meter?

      --
      Three days from now?? Thats tomorrow!! ~Peter Griffin
    2. Re:Not a camera by fche · · Score: 2

      The trick is that the light source varies with different samples. What this apparatus appears to be computing is a dot product (overall image intensity) with a series of 2D wavelets. Then inverse-transform the coefficients to a 2D image.

  4. Flaming periniums Batman! by tgibson · · Score: 2

    Victorian doctors would look for testicular cancer by holding a candle behind the scrotum

    I hope that they actually held the candle in front of the scrotum and looked from behind.

  5. Re:Mmm... by TWX · · Score: 2

    I don't want him to come near me with a candle either. If I were to make a list of places that I don't ever want set on fire, after my face and the rest of my head I think that would be next.

    --
    Do not look into laser with remaining eye.
  6. Re:Strange KFC advertising by TWX · · Score: 2

    With the candle, it's probably a Burger King product... Flame Broiled.

    --
    Do not look into laser with remaining eye.
  7. Dual Photography by Required+Snark · · Score: 4, Interesting
    Researchers from Stanford demonstrated in 2005 how to generate an image of a scene from the point of view of the light source instead of the camera. It's called dual photography, and has some similarities to the single pixel technique.

    We present a novel photographic technique called dual photography, which exploits Helmholtz reciprocity to interchange the lights and cameras in a scene. With a video projector providing structured illumination, reciprocity permits us to generate pictures from the viewpoint of the projector, even though no camera was present at that location. The technique is completely image-based, requiring no knowledge of scene geometry or surface properties, and by its nature automatically includes all transport paths, including shadows, interreflections and caustics. In its simplest form, the technique can be used to take photographs without a camera; we demonstrate this by capturing a photograph using a projector and a photo-resistor. If the photo-resistor is replaced by a camera, we can produce a 4D dataset that allows for relighting with 2D incident illumination.

    It exploits Helmholtz reciprocity to swap the camera view with the light view. If light is modeled as rays/photons, the path between the light source and a camera pixel is the same going from the light to the pixel, or the pixel to the light. Hence reciprocity.

    --
    Why is Snark Required?
  8. Re:Mmm... by MaskedSlacker · · Score: 3, Funny

    Your priorities are clearly backwards.

  9. Re:Single-pixel what? by Arkh89 · · Score: 5, Informative

    Ok, let's say that you want to build a 1 "mega-pixel" camera (1000x1000 pixels, for instance). You have the optics but not the sensor array. Instead, you only have a single photo-diode... which is basically a single pixel.

    First approach : you decide to scan the image plane with this photo-diode, trading spatial resolution for time. You move the photo-diode to where the first pixel in the top-left corner of the sensor should be, integrate (collect the photons) for some time, then move to the second pixel position. After making 1 million of such movements/integrations, you have fully sampled the image plane and have a complete 1 "mega-pixel" image.
    Problem : this is slow as hell, you need to move the photo-diode up to some accuracy, etc.

    Second approach : instead of moving the photo-diode you will modulate the incoming signal (photons) and integrate everything to this detector. You take a small video projector and open it to find a component called a DMD which is an array of controllable bistable micro-mirrors. Basically, displaying an image on the video projector is turning this surface as a transmissive gray-scale pattern (note that it is not actually transmitting light, just reflecting). You put it in the image plane (at the position of the sensor array) and you use a lens to focus all of the light coming out of the DMD surface onto the photo-diode.
    Now, instead of scanning, you just have to display a pattern consisting of a "black" frame (fully "blocking") except only one "white" pixel ("transparent") and integrate as usual. As you know which patterns was used for each integration and can, as previously, rebuild the image.

    Second approach, first improvement : instead of lighting pixel per pixel you can use specific patterns. The basic idea is to integrate photons coming from multiple pixels at the same time and reconstruct with a specific algorithm. The idea is to express the problem as a linear equation A x = y where x is the input image, A is the measurement operator = a matrix representing the system and y is the measured vector. In the previous case, you were measuring pixel per pixel which is equivalent as modelling A as the identity matrix (ones on the main diagonal, zeros everywhere else and so y = x). Imagine now that you use another matrix / another way to combine multiple pixels, such that each row of A is pattern you have to display on the DMD and the matrix row is still square and full-rank (a well defined system). In the end you can still reconstruct x from y with A' y = x (where A' is the inverse of A) and get back your image.
    Why would you do this? Well, instead of getting a bunch of photon from a tiny opening you will be measuring many more photons which is a good thing as our real-world detector is noisy. You will thus increase the signal to noise ratio.

    Second approach, third improvement : the main problem of the previous system is that, to obtain a 1 mega-pixel image, you still need to do 1 million projections/measurements which is a lot, and makes the whole process slow. But, you know for a fact that images are compressible signals (JPEG is a proof of that) which means that you can represent any 1 mega-pixel image signal into a much smaller vector size. This is because natural images are not random structures and possess some level of coherency = redundancy between pixels. So instead of making as many projection as they are pixels (a square matrix), you will do less, say by a factor between 4 and 10. The matrix A becomes rectangular and you have to use a more complex reconstruction algorithm (non linear, or based on a convex optimization system) which takes into account prior knowledge you would have of natural images (think of it as external constraints that will help you make the system sufficiently well behaved).

    This is basically how single-pixel cameras work (with compressive sensing)...

    I'll pass for the bonus point.

  10. Chicken tissue is a stand in for human soft tissue by hamjudo · · Score: 3, Informative

    They are working with 6 mm samples. They need to improve that by a factor of 5. Only a small percentage of women at risk for breast cancer can tolerate having their breasts compressed to 30 mm for imaging, but it is a large enough percentage to start doing human test trials. Assuming the image quality is high enough.

    With existing xray based mammogram machines the more the breast is compressed, the better the image. There is abundant research on breast compression for imaging, just a google away.

    Perhaps in a few years, this technique will be refined to the point where it can image through 3 cm of tissue in a reasonable amount of time, and produce a clinically useful image. Then we will hear about this technique again. Hopefully, it will be improved to the point where it is suitable for use on the entire population.

  11. Re:Single-pixel what? by drinkypoo · · Score: 2

    No, the sensor isn't moving, except in case 1 in which the principle is illustrated. What it sounds like to me is that instead of moving the sensor, you project combinations of patterns onto the lens such that it cancels out every area except the one you want to sample. You subsample the image area and then interpolate the contents.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  12. Re:Single-pixel what? by PopeRatzo · · Score: 2

    You know, this Thanksgiving weekend, I'm grateful for the number of very smart yeggs what hang out here at Slashdot. It's honestly inspiring.

    I ask a question and I actually got patient, thorough explanations, on the Internet. You don't find that over at the Twitter or 8chan.

    --
    You are welcome on my lawn.
  13. Re:it's possible by Immerman · · Score: 2

    Why does every self-righteous pedant on the net always assume such mistakes are a lack of knowledge, rather than a typo? Personally I've known my itses, thereses and yourses since grade school, but when I'm busy trying to type a tenth as fast as I think homophones slip through from time to time. And if I'm bothering to re-read my post before submission to a discussion forum I'm probably only skimming for conceptual coherency, sew I'll likely miss at least sum of the words that seam okay in passing, be they homophones or minor typos.

    And by this point I think it's well established that whatever the Slashdot "editors" do, it's nothing related to verifying the summary is event vaguely accurate, much less grammatically correct.

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.