The Future of Digital Camera Technology
An anonymous reader writes "CNet News has an interesting look at where digital camera technology is headed now that the megapixel buzzword can be put to rest. From the article: 'In compact cameras, I think that the megapixel race is pretty much over,' says Chuck Westfall, director of media for Canon's camera marketing group. 'Seven- and eight-megapixel cameras seem to be more than adequate. We can easily go up to a 13-by-19 print and see very, very clear detail.'"
Why all the big attachment to JPEGs?
Isn't it better to be taking lossless pictures with digital cameras anyway?
(My digital camera only writes in jpg format. I'm not sure if this is rare amongst digital cameras nowdays, but it doesn't seem ideal.)
...for all but the most discriminating consumers. The only difference with 8MP cameras is that now people are posting 4MB images on their Web pages, or emailing them to Grandma who's still stuck on dialup.
Better quality CCD sensors with very low "noise" even at high ISO settings (ISO 1000-1600). This will likely require either larger size sensors or improved semiconductor design for the CCD sensor itself.
Amended quote: 8 megapixels of resolution should be enough for anybody.
I personally carry my phone around far more than I do my camera, and consequently I find myself taking photos where I'd normally be wishing I had my camera with me. Integration can be disastrous if the usability of any of the devices is affected, but if done properly, it can be excellent. Bring on the iPod Camcorder Phone!
There are two other things that can make or break a camera
What seems to slip by the average digital camera buyer, is that megapixels are only relevant in relation to the size of the CCD/CMOS.
SIZE does matter.
BIGGER is BETTER.
Here's a great website that does a basic talk about sensor sizes
If you follow the links you'll learn a lot more about why the sensor & pixel size are possibly more important than just the megapixels offered.
[Fuck Beta]
o0t!
Try running Mozilla Seamonkey on 1 GHz hardware. It's possible, but not enjoyable. And remember, that's just an email client and a web browser. Likewise, try running OpenOffice. Again, it's not a good experience, even on a system with 1 GB or more of RAM.
Don't ever underestimate the ability of software to become far more bloated, and less efficient. It's a problem that has plagued the industry for years.
Cyric Zndovzny at your service.
Now that we have cameras of a decent MP maybe we could stop saving as jpeg and instead use a lossless format?
Er, it's called RAW, and all pro cameras and even a lot of pocket cams are capable of using it. This is unrasterized data, so it's about as lossless as it gets (even TIFF is destructive because it rasterizes the images before it's saved).
The problem with RAW formats right now is that they're all proprietary, but this isn't really that big of a deal in practice. Generally speaking, if an image editor supports RAW at all, it will support every major camera. And every camera that supports RAW also ships with its own conversion software (so you can save as whatever format you want).
7 or 8 megapixel may be adequate for consumer cameras but even the highest pixel count availible doesn't match the needs of a lot of professionals. They've finally hit pro level but for high res work many still need to use film. The mass market race is over but pro cameras will keep increasing for years to come. A 4'x5' still has far more resolution than the best camera on the market today.
As a professional graphic designer and artist, I feel that we'll still need a bit more in order to say "we've got enough pixels." For instance, I do a lot of texture photography - shots of various objects, capturing as much of a surface as I can. I want my stock textures to be as high-res as possible, because there are times where I need to isolate very small areas and blow them up to an extreme. Same goes for regular stock photography; I need to be able to isolate and blow up certain parts to an extreme, and I can't always set up a nice macro shot (with a random occuring event, such as a drop of water).
In short? No, 8mp isn't enough for me.
"Better to be vulgar than non-existent" -Bev Henson
I'd suggest making cameras able to wirelessly connect to another portable device you could carry in a pocket of purse that acts like a hard disk and could store 100GB of files or more. That and improved batteries would be great.
On one hand, you suggest a technology that sucks the ever-loving batteries dry and on another, you suggest improving batteries. Battery life is probably far better without using wireless. Batteries are a chemical energy storage technology that simply cannot, by their very nature, improve as quicly as transistor process technology, the best way to improve battery life is to make electronics not draw excess current in the first place. Flash cards are improving in size pretty well. Anything higher than 5MP is going to demand practice and heavy stabilization, through optics and a tripod, to take full advantage of the sensor resolution.
I have a suggestion: VIDEO.
However many megapixels, but I can still only capture 640x480 video. theres no reason this couldn't be full PAL/NTSC or even HD - add a weight to it and you have a extremely good quality video camera for very cheap.
Let me edit the camera OS and I'll implement it myself, including time lapse or variable frame rate. I'll connect it to my laptop so i don't run out of space.
They keep wanting to milk us for every new "HD" format video camera.
The other thing they can implement is HDR photography. I know RAW is good, but if they can master true HDR that would be awesome.
Rich Gentlemen Hide - The Existential Comic
A little less than a year ago, a graduate student at Stanford gave a talk on light field photography at the University of Washington. The results were extremely impressive. Basically, by inserting an array of microlenses in front of the CCD, you can determine the direction of every ray coming into the camera. You lose resolution, but who needs 8 megapixels anyway? What you DO get is the ability to refocus the image in software, and take photos in low light and still retain a high depth of field.
I highly encourage you to check out his light field photography site, including his galleries, tech reports, and papers. It'll blow you away.
A 13MP RAW image is NOT 39MB. Each 'pixel' in a digital camera only has one color (red, green, or blue typically, sometimes white (Sony), other colors could be used) - it's 8, 10, or 12 bits of data (you won't find 16 bit D/A conversion in a digital camera - it isn't practical and it's well beyond the human eye's ability to discern anyway - though you could argue it would be useful for making very large corrections in saturation or brightness without losing quality) - so stored with no compression at all this is at worst 13 x 12bits = 21.5mb. Add in the fact that you can get a decent compression ration across this data (and your typical 6-8MP DSLRS certainly do) without any loss of data ... maybe 15mb ... or less.
I was looking at an ad in the New York Times just last week. It was a full-page photo for a major telecom and all I saw was pixels. It was something and art director would never have stood for even a couple of years ago but will accept today in exchange for the digital workflow and instant gratification. I'm not sure a lot of people who state how much resolution is enough have ever seen a good print made from a piece of large format film. But then again this isn't so different from what large format photographers were saying when 35mm came on the scene and it turns out the world was big enough for both.
My relatively old camera has exposure bracketing, which has proved useful a few times for me. But focus bracketing would save MANY more of my photos. I'm imagining that the camera would take a photo at whatever the current focus system does, then focus out a bit, and focus in a bit (Ok, I don't know the terminology). It's far too often that my particular camera doesn't quite focus right. Either I aim it wrong, or the lighting throws it off, or maybe in hindsight, I just wish that I had focused on something else. Plus, editing the photos later would be much more interesting.
Who the fuck modded this +5?
What he's asking for already exists. You can use RAW mode or some cameras will even save as TIFFs if you don't want jpegs. Same for wireless - that stuff is already available (although not mainstream -- yet). Current batteries aren't bad either (heck, I can fill a 2GB card on a single battery). Also, for pros who do a lot of shooting, there has been specialized battery packs for years [for the camera AND flashes] and such solutions...
There are plenty of things that suck with cameras nowadays, and these things aren't it.
The interface/menus on most cameras suck (especially P&S cameras - those menus are like a fucking maze, and what about the impossible to remember button combinations for anything non-trivial?)
Dynamic Range. I don't want more megapixels, and current noise levels are about as good as they'll ever get (compromises). But I *WANT* more dynamic range already - even better, a film-like "shoulder" in the response curve (in the highlights) - without having to combine pictures. It's annoying to have to combine shots all the time (even if one uses ND grads). This is perhaps the biggest issue with regards to digital photography right now.
What about that four thirds "universal" system they used to talk so much about? I don't want to sell all my Nikon glass (several thousand $'s worth) to be able to use a Canon camera, or what if I wanted to use a Canon lens on my Nikon? This was supposed to let you do it by swapping a mount/adapter. Absolute freedom! No more system lock-in!
The lighting system on most cameras is quickly becoming a mess. Forget about tried and working "real" TTL (matrix, color matrix or whatever). Now you need special oddball not-quite-TTL (dTTL/eTTL/iTTL) flashes for every new camera they put out... It's getting more complicated as you try to use things like plain TTL strobes and such... CCDs made this harder, and they try to make you believe it's better now, but it isn't.
There are tons of things that could really improve...
There are many things which have improved a lot on recent cameras: things like startup times and shutter lag, orientation sensors are pretty much standard, etc.
People worry too much about megapixels. You also need the [expensive] glass with sufficient resolving power to make use of it. And for 99% of the population, it's already overkill. How many megapixels one needs to make bullseye snapshots of their dogs? Give 'em a million megapixels and their photos will still suck. And resolution isn't "linear". To have a picture twice the size in each direction, you need 4x the resolution i.e. the difference between a 5 and a 6MP camera is nearly non-existant. If you need more megapixels than the current cameras, most likely you'll need to switch to a medium format camrea with a digital back (mainly because even the most expensive 35mm lenses only have so much resolving power), which will cost tens of thousands.
I am surprised they didn't talk about speed. Latency and shot to shot. Every consumer level dicital camera I have tried so far was incredibly slow compared to a cheap film camera. I would buy new camera every two years if it was significantly faster.
AccountKiller
I'm the grandparent, just not logged in because I'm in a public place.
JPEG is a balance between size and quality, I realize this. So do you, I guess. I also have a 20D, and several 35mm Canons--I'm a fan of macro photography. However, shoot your scenes with both RAW+JPEG when you get the chance, using superfine compression, and compare for yourself.
The 20D's JPEG encoder is terrible. It's optomized for battery life: low processor usage. Photoshop can produce *****much***** better results from tiffs converted from RAW. Canon's encoder produces all sorts of noise, particularly in out-of focus areas, and otherwise kills small detail badly... In other words, it screws up good bokeh! It produces so much noise as to be utterly unacceptable (to me) when working with any sort of depth of field, both in macro and portraiture--even when using low iso (the RAW isn't noised up, but the JPEG is), and it can blur out smaller details that are preserved in the RAW. Furthermore, JPEG causes nasty banding in areas that should have subtle tonal changes (very smoth gradients, like the sky), and to my eye, it enhances chromatic aberration found on cheaper lenses, and can cause a noticable amount of posterization (again, erasing details). This makes any investment you've got in a good large arperature Canon L lens, for example, absolutely worthless.
Oh, sure, you can fix up much of that in post processing, Neatimage, etc, but you'll spend quite a bit of time doing it, and your good photo will be slightly less good than it would have been otherwise... I've blown some of my macros taken with the 20D up to 25x16 inches, and I've even compared the same image printed at this size from RAW and the identical image printed from JPEG, with no post processing on either. RAW wins by a huge margin. The color is better, there is much less noise, no banding, much nicer histograms, too... And this is not using any additional filtering in the RAW conversion workflow, just in case you're wondering.
Like I said, it's not an issue with 4x6 prints to be hung up on grandmas' fridge, but is definitely apparent at 8x10, and even more so at larger sizes. If you can't tell the difference, you need glasses... But I can understand if you still go with JPEG because you don't want to manage such large files.
I lay out books and magazines for a living, and the vast majority of images that come to us are 300 dpi jpegs, or tiffs and eps's converted FROM jpegs. We routinely print oversized glossy material, which uses trim sizes greater than 8x10 in virtually all cases. We have had no quality issues, and I speak from a production environment.
Resolution is more important than compression method. Ten times out of ten I guarantee you couldn't tell the difference between a RAW file and a Fine JPEG image.
The color problems you speak of are caused by the camera, not jpeg itself. The jpeg file format is capable of rendering in any color space, and provides excellent color reproduction. Problems can arise from the internal jpeg engine in the camera, which in a less expensive model may not accurately convert the raw data from the sensor.
--They say only a fool looks at the finger pointing to the sky...
I'm glad that my digital photos don't all take up 19TB apiece -- but I am puzzled by the idea that I should be complacent with a given MP number as "good enough." I want shots that are infinitely detailed, and (at least in the area of interest) infinitely sharp. Since neither of these is an available option, I've got to settle for for "sharp enough that I can stand it" and "as detailed as the lens and sensor let me get."
...
;)
Doesn't everyone at some point end up cropping their digital photos, and hitting the jaggies? The main reason I'd like more (and more and more) resolution is because I don't *know* how big I want that photo to be shown in the future, and I don't know if cousin Vinny has a hilarious expression on his face that will be lost in the haze at 5MP but might be a treasure at 10MP
The idea that 8 or 10 MP is "enough" and that now everyone can just go home and be happy isn't completely groundless (we've certainly reached a point where "more pixels" isn't the main thing being sought by camera buyers), but it's only true while other things (sensor designs, storage capacity, cheap-yet-bright-and-not-too-heavy lenses) catch up and remind us that data uncaptured is data that can't be restored.
I'm sort of hoping that mid-range DSLRs hit 12MP in the next 2 years, and that Pentax still makes one that runs on AA batteries
timothy
jrnl: http://tinyurl.com/c2l8yr / foes: http://tinyurl.com/ckjno5
Want to save an image losslessly? Digital SLRs (and some point in shoots) let you save in RAW. Not only is the image saved losslessly, but you can adjust white balance, exposure (within reason), sharpness, and more all after taking the photo!
Want decent optical zooms? SLR lenseshave been available for decades now that range from 8mm to a whopping 1200mm. That's over 100x for you guys used to talking about lenses in terms of "how much zoom" they have. Canon's lens selection.
Want 13MP? The Canon 5D does 12.8. The Canon 1Ds Mark II does 16.8.
Want storage? You can get CF/SD cards as large as 8 gb, and portable hard drives such as the Epson P-2000 made for offloading photos out in the field.
Want to wirelessly transmit photos? The 1Ds Mark II can do it with the WFT-E1A.
Current batteries can let you shoot 2500 shots on a single charge. Spare batteries are cheap and keeping spares in your bag is no big deal.
The thing is that all this technology is already available, but be prepared to spend thousands of dollars for it. If you're looking for all this technology crammed into an everyday point & shoot, give it a few more years.
Instead of more MP, how about better high ISO capabilities? No shutter lag from when you press the button to when the camera takes the picture? How about taking photos at 8fps? Instant-on when you power up your camera? Quicker autofocus? These features are very important, but these too are available on DSLRs, and for a price. Considering how little money you're spending on a point & shoot, they do quite a bit as it is and they'll only get better. The technology is already there and it will eventually find its way down to lower end cameras.
They tell you the camera has 8MP, but "forget" to mention that in reality it has 4M green pixels and 2M of each red and blue. And there's a blurring filter in front of the sensor to reduce moire. So if you photograph fall foliage, your 8MP camera turns into a 2MP one at best. In the BEST case, it's a 4MP camera really, not 8MP.
The only sensor that takes full RGB readings at each sensor location is Foveon, but it suffers from inferior color reproduction and lower ISO sensitivity. It's also pretty low on "real" pixel count - currently at around 3.5MP (which in Canon/Nikon terminology would be called 10MP, because each pixel takes full RGB readout). Foveon pictures are extremely sharp, though, and render textures very well. If they solved their color reproduction issues and upped the pixel count to "real" 5MP - I'd RUN to the store with my credit card in hand to buy a camera based on this sensor.
I thought we were pushing the theoretical limit for that - there are only so many photons impacting the sensor surface, and it's not possible to catch many more with much more accuracy than we already are.
Actually, even if you had a theoretically "perfect" CCD or CMOS, you can catch about two-to-four times as many photons.
The problem lies in the way the photosites capture light. Most designs are variants of the every other location is green with red and blue alternating the others. Something like:
RG
GB
Green gets twice the representation as human eyes are more sensitive to green and thus more detail in that part of the spectrum is considered desirable.
A recent trick to squeeze out more is to turn the photosites at 45 degrees to the grid you actually capture. You're then forced to interpolate more but the theory is that you get a smoother response.
Regardless though, any given location can catch red OR green OR blue parts of the spectrum. If green falls, 50% of it is lost. If red falls, 75% is lost - same with blue. You're always throwing away half to three quarters of your photons simply by having photosites dedicated to individual colors.
With Foveon they try tackling things differently. By exploiting the fact that different wavelengths can penetrate silicon to different depths, they figured you can have a three layer deep photosite that captures red AND green AND blue - none of this ignoring chunks of the spectrum and throwing away data.
Of course, for all it's a cool idea, it's proprietary, has only made it in to a few cameras and doesn't seem to be hitting its full potential yet. My guess is there's still quite a bit left that can be squeezed out of CMOS (Canon's 10D got noisy at-or-just-after 400 ISO wherease the 20D, 18 months later, could handle 800) and we'll see them follow that technology for a while whilst waiting for Foveon to move out of patent protection.
Still, in the future, I'd imagine we'll see Foveon or something different but exploiting some similar concepts replace individual colored photosites. Until that point, no matter how good things get, there's always a full stop of light's worth of extra quality sitting and waiting.
This really is different from the 640K limit.
The 8MP (or whatever it may end up being) limit is defined by human perception. If no human being can distinguish between a photograph displayed at resolution A and the same photo displayed at resolution B which is greater by some factor, then B is more than adequate and nobody's going to want or need anything beyond that, even if it's techonologically feasible.
In digital audio, we really have reached the limit of human perception, which is probably around 320KB/s, 48kHz. There is probably no technical problem in creating digital audio at 4MB/s, 1Mhz, but you don't hear any audio engineers asking for it.
No similar limit of perception applies to our ability to use and store information.
"A one megapixel camera has one million blue photo detectors, one million red photo detectors and one million green photo detectors."
A 1 MP camera has one million photodetectors, half of which are green, 1/4 red, and 1/4 blue (in most cameras). From this image a one megapixel output image with all RGB components for each pixel is interpolated.
Then there is the issue about bits per pixel. Sensors commonly has 10 or 12 bits per pixel. With a 12 bits per pixel, 13 MP sesor you thus get:
13M * 12 = 156 Mbits = 19.5 Mbytes.
In terms of LCD framing - it has been done - check out the Olympus E330 - they're marketting it as the World's first digital SLR with continuous live view:e 330evolt.asp
http://www.dpreview.com/news/0601/06012606olympus
Personally I prefer to use the viewfinder everytime - but put that down to what I'm used to. I'll bet Olympus will sell alot of these cameras to those like you upgrading from a digital compact who demand the lcd viewpoint. The real sales point for this particular DSLR though is the ultrasonic CCD dust cleaner - I'm really hoping Olympus licences this technology out to other manufacturers... cleaning the CCD every couple of months with a swab and alcohol is something I'd like to lay rest to history - and something that most DSLR manufacturers choose to keep quiet about when selling their cameras...
I'd be quite happy with a digicam that took photos at 1920x1080 or even a multiple of that, say 3840x2160, in the aspect ratio of all future TVs and monitors (ok, 16:10 seems to be the monitor ratio thanks to stupid Microsoft and their idea of having HD res PLUS room for taskbar.... but close enough).
Anyone else notice how digicams all take 4:3 pictures these days no matter how high end they are, just as the public is moving to 16:9 as the default ratio?
So....
any digicams out there ahead of the pack and already implementing widescreen resolutions by default?
I would think that a 1920x1080 camera phone would be quite the sweet spot for storage and speed while preserving good quality pictures for viewing on TVs direct from the camera....
Anyone?
Visceral Psyche Films
"In compact cameras, I think that the megapixel race is pretty much over," says Chuck Westfall, director of media for Canon's camera marketing group. "Seven- and eight-megapixel cameras seem to be more than adequate."
Anyone care to guess how long it will be before this quote supplants "640K should be enough for anybody" as the Worst Technology Prediction Ever?
I would say the digital photography field is just a little different than the general computing field, so that really isn't that bad a statement. Your average snapshooter isn't clamoring to print his photos at 36x48 inches nor crop 90% of their image and still expect to have decent resolution. There are a lot of people who are really quite happy with their 3- and 4-megapixel cameras. Having eight or more megapixels is just icing on the cake except for people who actually need or want the extra resolution for various reasons. Even a sharp 3MP photo can often be printed up to 13x19 and still look decent. At the consumer level we really have reached the flattening-out part of the curve in terms of the megapixel race.
What the digital camera world really needs more than ever-increasing megapixels at this point is A) improved dynamic range, B) less noise at high ISO ranges (800-3200+), and C) more cameras with built-in image stabilization. These three things will actually solve real-life problems that people have when taking pictures.
I think dynamic range is the biggest problem. Cameras just aren't capable yet of getting information out of both deep shadows and bright highlights in the same image the way our eyes can. This is confusing to most people and ruins a lot of shots. "Blown" highlights and pure black shadows with no retrievable information are the bane of the digital photography world. Sure, you can shoot RAW and try to manipulate it in Photoshop, but that is really way beyond most people.
Besides dynamic range, most shots are ruined by blur. Either the shutter speed was too slow to stop the movement of the subject, which can be helped a lot by higher ISO capabilities, or the camera was moving too much, which can be helped quite a bit by some built-in image stabilization. Bottom line is, lack of megapixels is no longer the cause of most unacceptable photographs for most people. Except for the pros, it's time to move on to improving other features. I can't really envision a world where regular people are screaming for 32-megapixel compact cameras. Ain't gonna happen.
"They tell you the camera has 8MP, but "forget" to mention that in reality it has 4M green pixels and 2M of each red and blue. And there's a blurring filter in front of the sensor to reduce moire. So if you photograph fall foliage, your 8MP camera turns into a 2MP one at best. In the BEST case, it's a 4MP camera really, not 8MP.
The only sensor that takes full RGB readings at each sensor location is Foveon, but it suffers from inferior color reproduction and lower ISO sensitivity. It's also pretty low on "real" pixel count - currently at around 3.5MP (which in Canon/Nikon terminology would be called 10MP, because each pixel takes full RGB readout). Foveon pictures are extremely sharp, though, and render textures very well."
This utterly fails to take into account how the human visual system works. It also fails to take into account the necessity of filtering when sampling. It also fails to take into account the sophistication of current interpolation algorithms.
The Bayer pattern is actually just about the most efficient layout for capturing images for human perception. I have done dozens of camparison of images capture using the 6Million Bayer arrayed sensors, versus 10.2 Million layered sensors. In the end they are essentially equivalent. The bayer layout allows you to do more with less by taking into account the human image processing system that is heavily organized to toward luminance/green information.
It is utter fanboy nonsense to say a bayer 8MP camera turns into a 2MP when taking fall foliage shots. In any real world situation including fall foliage, an 8MP bayer camera like the Canon 350D will capture more detail than the Foveon sensored SD10 NEW 10.2 Million Pixels (3.4 Mp Red + 3.4 MP Green + 3.4 Mp Blue) (description from Sigma USA page).
As technical bunch we should be able to understand that optimization is sometimes better than brute force. By tilting the sensor toward green, it is tilted toward luminance capture and tilted toward the way humans view details.
In thousand of empirical comparison online, parity is reached when there is an approximately equal number of green sensors. So 6MP bayer (3MP green) where approximate equal to 10.2MP foveon chip with ~3MP green. Actual 10MP bayer (5MP green) cameras like Nikon D200 easily capture much more detail than Sigmas 10.2MP chip.
The sampling issue. The Sigma has no filter to prevent undersampling artifacts. It doesn't suffer from colour moire artifacts, but it has plenty of luminance moire. See here for an ancient comparison of the 6MP Canon D60 and the 10.2MP Sigma SD9:
http://www.wfu.edu/~matthews/misc/DigPhotog/alias/
Scroll to the photo comparison at the end. The only extra detail in the Foveon based image is Aliasing errors. These are extremely prevalent in Sigma images with sharp diagnals, or repeating patterns beyond the Nyquist frequency of the sensor.
In the end, bayer is an excellent engineering optimization to do more with less. The real comparison that counts is how does it compare with film. A 6mp Bayer sensor in an DSLR is already better than 35mm film. By 10MP it is significantly better.
The other important factor is how the bayer DPI translates in the printed image. I have found that around 240 DPI is close to optimal image quality. So a Canon 350D with a 3456 pixel image width can produce a superb quality image about 14 inches wide. Be aware this is not to say you can't print larger. This is highly subjective depending on source material, but with detailed material this is the point where I consider that you would be hard pressed to notice any improvement from more pixels.
So even if you only want to print 13"x19" I think you could still see improvement from more pixels if printing detailed subjects like landscapes.
You can argue the quandry of subject, material and view distance till the cows come when considering viable prints size. I mere wish to express what I consider the
A 8MP camera is equivalent to a 4MB camera plus a x2 zoom.
Not quite. An 8MP sensor has sqrt(2) = 1.4 times as many pixels in each direction to get twice as many pixels overall. So it's only equivalent to a 1.4x zoom.
You actually need to go to 16MP to get the equivalent of a 2x zoom on 4MP, which is quite a different proposition.
The other problem of more pixels is the one you mentioned yourself - more noise. A low noise 800MP sensor would be far too big to fit in a normal sized camera.