Slashdot Mirror


Canon Unveils 120-Megapixel Camera Sensor

Barence writes "Canon claims to have developed a digital camera sensor with a staggering 120-megapixel resolution. The APS-H sensor — which is the same type that is used in Canon's professional EOS-1D cameras — boasts a ridiculous resolution of 13,280 x 9,184 pixels. The CMOS sensor is so densely packed with pixels that it can capture full HD video on just one-sixtieth of the total surface area. However, don't hold your breath waiting for this baby to arrive in a camera. Canon unveiled a 50-megapixel sensor in 2007, but that's not made it any further than the labs to date." It's probably not going too far out on a limb to say that the any-day-now rumored announcement of an update to the 1D won't include this chip, but such insane resolution opens up a lot of amazing possibilities, from cropping to cheap telephoto to medium and large format substitution. Maybe I should stop fantasizing about owning a full-frame 1D or 5D and redirect my lust towards 120 megapixels.

40 of 289 comments (clear)

  1. Noise/Light Sensitivity/Optics by Greymist · · Score: 5, Insightful

    I'm just curious what this would be like in low light settings, cramming that many pixels into such a small space has got to have some effect on sensitivity.

    1. Re:Noise/Light Sensitivity/Optics by spun · · Score: 2, Interesting

      I'd bet that you could use that many megapixels to seriously boost dynamic range by averaging several adjacent pixels into one.

      --
      - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
    2. Re:Noise/Light Sensitivity/Optics by ceoyoyo · · Score: 2, Insightful

      How would that help dynamic range?

    3. Re:Noise/Light Sensitivity/Optics by ceoyoyo · · Score: 2, Insightful

      I'm familiar with HDR, thanks. You'll note that the article you linked to doesn't contain the words "average" or "averaging."

      HDR requires that you have the same picture but with multiple, different exposures. You could potentially acquired this in one shot by making adjacent pixels more or less light sensitive (which has to be done in hardware), but averaging identical pixels isn't going to help. Nor does the HDR process involve averaging, even with multiple exposures.

    4. Re:Noise/Light Sensitivity/Optics by Jarik+C-Bol · · Score: 2, Interesting

      not *quite* you could still get say, 40 megapixels. A very basic HDR picture is the combination of 3 ranges, so if you took your base picture on one pixel, and the bracket range on the pixels to its left and right, (i'm generalizing here of course, the tech would not be THAT simple) the output is a 40MP picture with a dynamic range 3x what you would get with a standard 40MP camera. the fact that your saying "get good dynamic range" shows that you don't know much about the subject. Normal cameras simply *don't* have dynamic range, they take photos of a very narrow range of light, based on your film shutter speed, etc. basically, a camera that automatically got ANY dynamic range, is an improvement towards being able to capture true to eye/life images.

      --
      I've decided to Diversify my Holdings. I've divided my cash between my left and right pockets, instead of all in one.
    5. Re:Noise/Light Sensitivity/Optics by Beardydog · · Score: 2, Insightful

      This is an actual question directed at you, not an argument, so bear with me... In a frame that captures the full available range in a scene (where a bright sky, for example will have detail), the dark areas will be underexposed and noisy, but not completely black (the way an overexposed sky will appear completely white). Couldn't four adjacent pixels simply be added together to produce an image with four times the range, and one quarter the resolution? So if, for example, three of the underexposed pixels aren't lucky enough to get a single bit of light, and one pixel gets lucky and grabs some, you can treat it like a single pixel that's sensitive to units of light 1/4 as strong (abundant? I don't know how it works) as the actual pixels. You'd probably get extra noise and blurring added, (for pixels that sit on actual boundaries in the captured scene, but are merged together), but in principle, wouldn't you get more range information in such an image?

    6. Re:Noise/Light Sensitivity/Optics by spun · · Score: 2, Informative

      Lots of people saying I'm right, too.

      Dynamic resolution and dynamic range are the same thing. If you take the value of one pixel, it will be three integers. If you average the value of several adjacent pixels, you will have three reals. There are more real numbers between 0 and 255 than there are integers between 0 and 255, therefore, the range of values has increased. (0,0,0) is still pure black, and (255,255,255) is still white, you can't get any blacker than black or whiter than white, you know. But using reals, you have more values between black and white than you did, and therefore, more dynamic range.

      Looked at another way, lets say a pixel is almost zero, or black. Using one pixel integers, it would round down to black, but averaging more than one pixel, one might find it wasn't quite black anymore. We have something between zero and one, i.e. greater dynamic range.

      --
      - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
    7. Re:Noise/Light Sensitivity/Optics by danpbrowning · · Score: 2, Informative

      Actually, the "sensitivity" (more specifically, e-/m^2) is generally the same across a huge variety of pixel sizes, thanks to microlenses. What is not usually constant is read noise (AKA "high ISO noise", sometimes also referred to as "sensitivity"), because although it does naturally shrink a little bit as the pixel size is reduced, it's not always in exact linear proportion with pixel diameter, and therefore the generalization that smaller pixels tend to have slightly more noise in low light.

      --
      Daniel
    8. Re:Noise/Light Sensitivity/Optics by bws111 · · Score: 2, Informative

      Resolution and range are not the same thing. Resolution is the number of increments within the range. Range defines how dark your darkest area can be compared to how bright the brightest area can be. Resolution is the number of shades of grey between black and white. If you have some areas of the picture that exceed the blackest black and others that exceed the whitest white you don't have enough range, and averaging pixels can not correct that.

    9. Re:Noise/Light Sensitivity/Optics by danpbrowning · · Score: 2, Informative

      Dynamic range is the distance between clipping and noise. The standard engineering definition assumes a SNR of 1:1 as the lower bound, but few photographers can tolerate that much noise and usually prefer 4:1 or 8:1. Random noise sources add in quadrature so that downsampling the pixel count by a factor of four increases the SNR by a factor of 2. A better way of thinking about it is this: the raw data from an image sensor has a noise power that increases linearly with spatial frequency (level of detail). Higher frequency (smaller details) have higher noise powers. If you throw away the high frequency detail, the noise goes with it. In actual practice, there are many better ways to reduce noise than by throwing away detail, and in any case, many viewers will prefer a detailed but noisey image over a blurry but less noisy one.

      --
      Daniel
    10. Re:Noise/Light Sensitivity/Optics by Peeteriz · · Score: 4, Informative

      In principle, you get the exact same result or worse as with a cheaper sensor with less resolution where each pixel is simply 4 times larger and gets 4 times the light for the dark areas, and the bright parts will be maxed out anyway. And HDR usually means a much larger exposure difference than simply 4 times - say, 10 stop difference is a 2^10 ~= 1000 times more light for the dark parts.

    11. Re:Noise/Light Sensitivity/Optics by John+Whitley · · Score: 2, Informative

      I'd bet that you could use that many megapixels to seriously boost dynamic range by averaging several adjacent pixels into one.

      Simply put: no. Software "averaging" may smooth out noise, but it will not add information that was not present in the first place. Missing dynamic range at the hardware is just not there to be recovered in software. In digital camera sensors, dynamic range is limited by saturation of the sensor's photosites. Once a photosite has collected enough photons, it registers maximum charge -- information about any further photons collected at that photosite during the exposure is lost. In fact, adding more photosites per unit area increases the per-photosite noise and chip areal overhead. Noise reduces dynamic range at the low end, and less charge capacity per photosite reduces dynamic range at the high end.

      As another poster notes, you might change the effective exposure received by each photosite (perhaps by Bayer-array like neutral-density filtering). Or you can do what Fuji did with the S3 pro: make a matrix of photosites of different sizes/sensitivites to improve dynamic range. Fuji's sensor, while nice, has hardly taken over the digital imaging world.

      On a more constructive note, Ctein wrote up a nice exposition on The Online Photographer about both near-term sensor technologies entering production and long-term avenues for advancement in digital imaging technology.

    12. Re:Noise/Light Sensitivity/Optics by GlassHeart · · Score: 4, Informative

      It's not possible to get more range out of a single exposure, because the range is inherent in the capture based on how much light you choose to let in, and how sensitive your sensor is to that light. Dynamic range refers to the difference between the brightest and the darkest pixel the sensor can distinguish in that exposure. Beyond the bright end of the range, they all look the same white to the sensor. Beyond the dark end of the range, they also all look the same black.

      Here's how HDR works, oversimplified. We take a shot where we meter the bright part, so that it'll be properly exposed, deliberately sacrificing the dark parts. All dark pixels will be black in this exposure because we didn't let in enough light for the sensor to make out the difference. We then take another shot where we meter the dark part, sacrificing any somewhat bright parts. All bright pixels will be white because we let in too much light for the sensor to make out the difference. If we then combine the two images by throwing away the dark parts of the bright shot and the bright parts of the dark shot, we get an composited image that has more range than either image alone, i.e., HDR. Note that no averaging is involved.

      The alternate solution ceoyoyo is talking about requires a different kind of sensor. Imagine if you had two kinds of pixel sensors, one sensitive and the other insensitive. You'd alternate them on your sensor, perhaps in a checkerboard pattern, but basically pairing adjacent sensitive/insensitive pixels. Now, if your sensitive pixel registers too high a value, then it's probably blown out so use the value from the insensitive one (which is by definition not as bright). If the insensitive one registers too low a value, then it's probably too dark, so use the sensitive one (by definition not as dark). The crucial difference here is that you choose one over the other, and never average. If all you did was average, then the result is the same as using a single kind of pixel sensor with a sensitivity in the middle, and would not improve your dynamic range.

    13. Re:Noise/Light Sensitivity/Optics by bws111 · · Score: 2, Interesting

      Let's say we have an image of 8 gray bars, with the brightest one 8 times as bright as the darkest. If we have a 3-bit sensor, with a resolution of 2 pixels per bar, we could adjust the exposure so the brightest bar had a value of 7, and we get the following pixel values:

      0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 and after averaging, we would have 0 1 2 3 4 5 6 7, which is an accurate representation. This sensor has enough dynamic range for the picture.

      If we take the same picture with a 2-bit sensor, and again adjust the exposure so the brightest bar has the value 3, we have the following pixel values:

      0 0 0 0 0 0 0 0 0 0 1 1 2 2 3 3 and after averaging, we would have 0 0 0 0 0 1 2 3. The entire left side of the image is black, all shadows are gone. Averaging did not fix that.

      If we expose so we keep the shadows, we wind up with pixel values of 0 1 2 3 3 3 3 3 after averaging. The entire right side of the image is blown. Averaging did not fix that. If we expose for the center, we end up with averaged pixels of 0 0 0 0 1 2 3 3 3 3, with the shadows gone and the hilites blown.

      Averaging can not make up for insufficient dynamic range.

  2. Need some sharper glass... or better physics by BWJones · · Score: 5, Interesting

    Canon had better come up with some sharper lenses with a sensor like this. I shoot shoot with APS-H sensors on the Canon 1D and many of the lenses that Canon, Nikon and Sigma among others make are not nearly sharp enough to deal with many more pixels than are on say... the Canon 1Ds. Zeiss makes some sharp glass, but with the pixel density Canon is talking about with this new sensor, I'd worry about noise in low light conditions like those on my last embed on the USS Toledo (world's first embed in a strategic nuclear submarine). Any sort of low light, high ISO images will be truly challenging environments for such small pixel imaging sites.

    It might be a great technology demonstrator or even a specific use CMOS chip for longer exposures, but I doubt it will have any applications in consumer or professional cameras unless some additional technology (or physics) comes into play.

    Also, one would have to come up with some new strategies for moving all of that data around. As it is, on the latest Canon 1D Mk IV, they are pushing 16.1 MP around at about 10 fps. With this new sensor, just the readout would prevent this sensor from being used in any but the most specialized of applications.

    --
    Visit Jonesblog and say hello.
    1. Re:Need some sharper glass... or better physics by localman57 · · Score: 3, Insightful

      Plus, sooner or later the general public is going to realize that megapixels aren't everything. A the output of a 6 megapixel Nikon D40 will amaze your non-photographer friends, while the 14Megapixel Samsung compact you just bought at walmart will most definately not.

    2. Re:Need some sharper glass... or better physics by BWJones · · Score: 2, Interesting

      Canon does makes some great glass and I shoot exclusively with Canon glass. However, Nikon, Zeiss and Leica among others also produce some pretty sweet lenses. Eventually, everybody is going to have to deal with issues related to the optics being able to actually resolve the imaging sites. At some point (and we are close), the glass will not be able to resolve anything more than the sensor can read out and you'd have wasted pixels. Kinda like the issue with Apple's Retina Display on the iPhone 4 that I wrote about here. Any more pixels would be wasted given the resolving power of the human eye.

      --
      Visit Jonesblog and say hello.
    3. Re:Need some sharper glass... or better physics by Anonymous Coward · · Score: 2, Informative

      The problem with modern digital cameras is that they are diffraction limited, http://en.wikipedia.org/wiki/Diffraction-limited_system, by the laws of physics, or very nearly so, given current day lens technology. There is no way you will get a higher actual resolution without going to lenses, which are significantly larger in diameter than what we are used to in dSLRs. So adding more pixels in the area of the sensor of the latest Canon 1D models is completely pointless, which is why we haven't seen an update yet featuring higher resolution.

      In other words: Keep dreaming. These new detectors are just marketing gimmicks, or intended for specialist scientific applications, like astronomy.

    4. Re:Need some sharper glass... or better physics by Amouth · · Score: 2, Interesting
      --
      '...if only "Jumping to a Conclusion" was an event in the Olympics.'
    5. Re:Need some sharper glass... or better physics by RemyBR · · Score: 2, Informative

      Your father's lens is probably in need of calibration. I use one of those and it shows none of this even when wide open. Or there's a change he got a bad copy, in which case calibration would still help, but not much.

  3. Still Cool by lymond01 · · Score: 4, Interesting

    45 MP photo to zoom into:

    Dubai

    1. Re:Still Cool by $RANDOMLUSER · · Score: 2, Funny

      Bleh. Flash. Yuck. They should have used JPEG for that 45 GP photo.

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  4. 150 megapixel by Anonymous Coward · · Score: 2, Interesting

    Good film under ideal conditions can handle 2500 line pairs per inch. The mathematical purist who was more obsessed with numbers than practical applications would want a sensor that can handle 10,000 dots per inch for copying film, and an image sensor of 5,000 dots per inch for shooting, with optics, electronics, and other hardware (and software!) to match.

    5,000 dpi on a standard 35mm 3:2 aspect ratio means 37.5 megapixels.

    For what it's worth, 10,000 dpi would be 4x that amount, or 150 megapixels.

  5. Size doesn't matter by $RANDOMLUSER · · Score: 2, Interesting

    I have to go with Ken Rockwell on this one: Megapixels don't matter. Unless you're blowing your 35mm shots up to poster size, pixel density over about 8 megapixels is useless overkill.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    1. Re:Size doesn't matter by Bryansix · · Score: 4, Insightful

      That article is OLD and he is not saying that Megapixels don't matter. He is saying that to see a difference you need to quadruple the megapixels and also that other things matter a lot like light sensitivity, pixel to space ratio, ISO performance and the like. He then goes on to say you would need a 25 megapixel camera to meet 35mm uality and that such a camera is not feasable. Well I have to give him a Bill Gates because it is moronic to say anything is not technically feasable because in 10 years you look like a fool.

      To get to the POINT, I own a Canon 5D Mark II which is a 21 Megapixel sensor. I have shot plenty of 35mm film and I can tell you without a shadow of a doubt that this sensor blows 35mm film out of the fucking water! You can see the images I take here. http://shezphoto.zenfolio.com/ and www.shezphoto.com Those are not even full res (although you can buy some of them full resolution). I have blown up the images to 24" x 36" and all the detail remains intact. I'm sure I could go larger but I just haven't.

    2. Re:Size doesn't matter by danpbrowning · · Score: 3, Insightful

      Ken Rockwell is to photography what a goatse troll is to Slashdot. (In fact, if you read his alien abduction pages, you'll see some similarity with goatse).

      It's like saying "Computer specs don't matter. Unless you're folding proteins, a 486 is just as good as i5." While it's true that sharpness and resolution are not the most important factors in a photograph, it's misleading as their benefits do in fact contribute to most styles of photography, just as a faster computer can contribute to a better experience for most computing needs.

      For example, most people feel that for an 8x10, there is no benefit to pixel counts above 6 MP, but in fact it takes a 24 MP before all the possible gains are realized, most importantly counteracting the loss in contrast from the anti-alias filter. (Many more MP would be required to hit full color resolution at Nyquist, but few natural images benefit from that, despite what the Foveon advocates claim.)

      --
      Daniel
    3. Re:Size doesn't matter by thegarbz · · Score: 2, Insightful

      Unforunately this sensor also blows many of the lenses Canon makes out of the water. Wake me up when glass gets perfect and the laws of nature w.r.t difraction are broken. Until the ... 120mpx *YAWN*.

  6. Uses by MBGMorden · · Score: 5, Insightful

    I'm sure the professionals would love such a critter, but as a person who likes to just take personal stills, to me the megapixel war is over. At this point in time I have a hard time getting excited over anything more than 10-12MP. They print just fine to photo sizes that I'd be interested in, and the truth is that MOST of my photos I keep digitally anyways where anything that has more pixels than my monitor is a waste (particularly with the ballooning size of these photos).

    I'm far more interested in seeing higher quality photos within our current megapixel options than seeing that particular number go up and up - afterall, there's a HUGE difference between your typical DSLR at 10MP and a $100 point and shoot at 10MP. That metric doesn't define the quality of the image.

    --
    "People who think they know everything are very annoying to those of us who do."-Mark Twain
  7. Parent should be +1, Funny by falzer · · Score: 2, Interesting

    You spell it Cannon and you're telling someone who shoots with a 1D and has likely used Zeiss lenses that they can't buy awesome Canon lenses in the toy department at Best Buy.

  8. Resolution matters for serious cropping by davidwr · · Score: 2, Insightful

    I'd love to be able to take many of my old family and vacation photos and take a small piece and blow it up to 4x6 or even 8x12 size without noticeable-to-the-casual-observer loss of detail.

    Imagine taking crowd-scene photos of a sporting event then when your friend said he was there and points his face out in the crowd, you can print him out an 8x12 of him and his friends.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  9. Re:here's a possibility I've often thought about by ZenShadow · · Score: 2, Informative

    Been there, done that, believe it was patented by iPIX. Not sure who holds it now since they're gone AFAIK...

    Seriously, they used this to do those 3D virtual tours.

    --
    -- sigs cause cancer.
  10. Definitely need better physics by delta407 · · Score: 4, Informative

    A more substantial problem is that diffraction limits the effective resolution of an optical system to well above the size of each of these pixels. This is a problem with current sensors at narrow apertures; lenses exhibit a measurable loss of sharpness, typically f/11 and up, because the airy disks expand as the aperture contracts. With hugely dense sensors like this, though... plugging some numbers into a website that explains the whole situation suggests that you'd need to shoot with apertures than f/1.8 to get circles of confusion smaller than the size of a single pixel.

    That's right--even "fast" f/2.8 lenses are limited by physics to never being able to project detail onto individual pixels. You could potentially add a deconvolution stage in software to recover additional sharpness, but not in hardware.

    Another thing. Do the math: the pixels are 2.1 micrometers square. Compare to trichromatic human vision, which detects red light peaking at 564 nanometers, 0.564 micrometers. The size of a pixel is within a factor of four of the wavelengths they measure. Staggering.

    Glass isn't the problem. We need new laws of nature, since we're near the edges of the ones we have now.

    1. Re:Definitely need better physics by danpbrowning · · Score: 2, Informative

      That's right--even "fast" f/2.8 lenses are limited by physics to never being able to project detail onto individual pixels.

      That is incorrect. Parity between the airy disk and pixel diameter is not the point at which additional detail becomes impossible -- that is only one point on the curve of diminishing returns. In other words, it is the difference between the "diffraction limited" spatial frequency and the "diffraction cutoff" spatial frequency. It is only the latter that denotes the impossibility of further resolution from decreased pixel size.

      The easiest way to understand this is to look at MTF. When diffraction causes the optical system MTF to drop to 50%, most would consider that the end of the line. But in fact, that is just the point where a lot of contrast is lost -- detail is still there and contrast can be restored with sharpening (e.g. RL deconvolution). MTF must drop to 10% before detail truly becomes extinct, and for a 2.2 micron pixel like this 120 MP Canon, f/5.6 will still give you 18% MTF, and there are a host of lenses that are very sharp at f/5.6.

      For further consideration, look at the effect of the anti-alias filter, which drops MTF of spatial frequences far lower than needed to suppress aliasing. The ideal solution to this problem is pixels that are so small that diffraction itself anti-aliases. That will increase contrast at lower spatial frequencies by 30%.

      --
      Daniel
  11. It matters for me... by PhantomHarlock · · Score: 2, Interesting

    From a professional photographer's standpoint, I DO appreciate more resolution, because I do make things that end up on posters and billboards. Also, the primary advantage in most cases is the ability to crop and still have a decent resolution image.

    As another poster mentioned, the main problem at this point is with the glass. Sharp glass that remains the same size to accommodate a denser, not larger sensor is a tough proposition, and the new frontier of technology. Things like liquid lenses may overcome this in the future, who knows.

    Right now, with my 21MP 5D Mk. II, I can use modern Canon "L" zoom lenses too my heart's content and have an image that is sharp from corner to corner, especially now that you can easily correct for chromatic aberration in RAW processing software. (to give you an idea of how far this has come, when I was doing 3D animation 10 years ago, we would commonly add back in chromatic aberration to 3D generated images to give them a sense of realism.)

    For the sort of resolution discussed here, if you wanted relatively sharp pixels at 1:1 (spatial, or perceived resolution, actual sharpness delineation from one pixel to the next) you would probably want to stick with prime (non-zoom) lenses with fewer glass elements, and it would probably OK.

    Other posters are correct in that this kind of resolution is currently unnecessary for consumer and casual use. But for me, large blow ups and two-page spreads are a frequent thing, and I apprecicate all the pixels I've got. :)

  12. The future is now by freelunch · · Score: 2, Interesting

    boasts a ridiculous resolution of 13,280 x 9,184 pixels

    My 6x7 cm film images are already 11,023 x 9,448 when scanned at 4000 dpi.
    And there are no artifacts from Bayer interpolation.

    30x36" prints, and even larger, are spectacular. But you need good lenses, a good tripod, and good technique; otherwise you won't resolve the detail.

    And with 20x30" prints only $9 at Costco (on profiled printers), I *am* enlarging my prints to poster size, thankyouverymuch.

    I look forward to digital catching up.

  13. Light Field Camera by cowtamer · · Score: 2, Insightful

    I'm sure it'll be perfect for this application:

    http://en.wikipedia.org/wiki/Plenoptic_camera (a type of camera that can let you re-focus (and to a certain extent re-position) images after taking the shot. The problem is that it requires a LOT of resolution to produce acceptable images).

    http://graphics.stanford.edu/papers/lfcamera/

    http://www.youtube.com/watch?v=9H7yx31yslM&NR=1 (demo video from paper above)

    http://www.youtube.com/watch?v=o3cyntPC2NU

    Here's one built with a 250 MP Flatbet scanner:

    http://www.youtube.com/watch?v=4O5fPoacF3Q&feature=related

  14. Dynamic Range, by 140Mandak262Jamuna · · Score: 4, Insightful
    I wish they would spend more time on improving the dynamic range than to just play the megapixel count wars.

    Instead of total pixel count, get one set of pixels to shoot at the equivalent of 100 speed, and the adjacent set of pixels to shoot at 200 speed etc etc. Then process the pixels to get details in dark regions and to scale the brightness. I would like a dynamic range (brightness ratio of the brightest to dimmest pixel) to be a million or more, not the present 1000. Human eye has a dynamic range of about 1 million (only in the fovea, not in the peripheral vision).

    --
    sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
  15. Think the other way by RickyG · · Score: 2, Interesting

    If you have the technology to make a 120 megapixel camera, reverse your thinking. Can you use that technology to decrease the size of your current product, so that a standard 8 to 10 megapixel camera is so small and compact, that it meets the needs of the growing phone/ipod/iphone/ipad industry?

  16. Re:A whiter shade of pale? by spitzak · · Score: 2, Informative

    Yes as I said below, averaging a lot of pixels would lower the noise floor and increase the range. However it increases the range by far, far less than if you used those N pixels for N different-exposed shots and this sort of huge range increase is normally what is meant by "HDR".

  17. To expand on this... by Estanislao+Mart�nez · · Score: 2, Informative

    I think this merits explanation in a bit more length.

    Nearly all digital cameras have Bayer array sensors, where each photosite only records the value for one of the three RGB color channels. A 12MP Bayer array camera produces full-color images with 12 million RGB pixels, but that overstates the amount of information that the sensor captures by 3x; for each pixel in the resulting image, only one of the three channel's value was actually directly recorded from the scene, and the other two channels' values were interpolated from the values of adjacent pixels that recorded the missing channels.

    Or, the quick way to put it, a 12 megapixels Bayer array camera is really 6 green megapixels, 3 red and 3 blue. This has several consequences:

    1. The sensor is susceptible to color moiré artifacts at its resolution limit. To avoid those artifacts, typically there is an optical anti-aliasing filter in front of the sensor that blurs the image a little bit, so that some of the light that would have fallen on only one photosite is spread to hit adjacent ones. This comes at a resolution cost.
    2. The effective resolution that you can get varies with the color of the subject. There's a good discussion of this effect at this page. But basically, if you're photographing a strong red or blue subject, your 12MP camera is closer to a 3MP camera.

    These two things mean that you can get resolution improvements from putting more photosites on a Bayer sensor, even if the size of the individual pixels is smaller than the circle of confusion of the lens.

    Imagine if the length of the side of the photosite coincided exactly with the diameter of circle of confusion. This means that a point on the subject that aligns perfectly with the center of a photosite is going to project entirely inside that photosite. Now assume that point of light is pure red. If the photosite is a red-sensitive one, the sensor then records the fact that the point has a strong red component, but it can't tell if it has a green or blue component. If the photosite is green-sensitive, then the sensor records the fact that the point has no green component, but it can't tell whether it has a red or blue component.

    Now, however, imagine that the photosite is smaller than the circle of confusion. Then some of the light is spilling over to adjacent photosites--which means that you record a value for all three color channels for that point on the subject. This makes it easier to infer the values of the missing channels at the pixel that corresponds to that photosite, because the adjacent photosites will have recorded it.

    So, making the pixels smaller beyond the lens' diffraction limit lets you (a) use a weaker anti-alias filter on the sensor (or none at all); (b) gives you more consistent resolution for subjects of different colors. If you go all the way, you'd make your sensor have 4x the amount of photosites as the number of pixels in the output images: e.g., you'd build a camera with a 60MP Bayer-array sensor but output 15MP images, using 4 photosites per output pixel (and no antialias filter). That would outperform today's 15MP cameras.