New Sensor Has Real Per-Pixel RGB Sensitivity
jonr writes: "Well, the holy grail of digital photography is finally found. A company named Foveon have developed a sensor that captures RGB colours on each pixel. So what you say? Well, for the past 30 years (or since the CCD was invented) we have been using CCD with with red, green & blue sensors (or cyan/magneta/yellow) and then used software to figure out the real colour. But Foveon is the first company to deliver RGB-in-each-pixel sensor.
For those of you who are not into digital imaging, this makes a lot of difference, it's would be just as revelutionary if somebody would make a flatscreen with a real colour pixels, instead of the RGB dots. dpreview.com has the scoop.
(No, it won't mean the death of film, but I suspect we'll see dramatic improvement in quality)."
You spend $3,000 on that Sony MiniDV camera with 3CCDs and it's quickly outdated.
No matter how many time I tell myself I'm over the fact that this will alway happen (stuff being outdated right after you buy it), the first thing that pops into my mind is "damn, if only I could have waited a little longer..."
Actually, this is very cool. Combine it with the depth capturing story we heard about earlier and hopefully dept projection and the future looks really really awesome!
So when a digital camera is said to have 3 mega-pixels, does that mean that it only has 1 million pixels for each color??? Thus, the actual resolution isn't 3 mega but 1 mega???
I can't wait until I can get this in something other than a $3,000 camera. The imagery I saw, even in jpeg format, was outstanding. Anyone wanna form a pool on when you can get a camera using this tech for $400? I say October, this year.
--- Think of it as evolution in action ---
More resolution, while nice, is not what digital photography primarily lacks. Light and shadow sensitivity is what really sucks with digital cameras. Film has a logarithmic sensitivity to light, while a digital sensor has a linear sensitivity.
Just out of curiosity, does anyone know of any technologies in development to give better light/shadow sensitivity.
Sometimes it's best to just let stupid people be stupid.
Personally, this is major droll material for me. I hope this technology comes to the consumer level by the time i'm ready to dish out money for another digital...
According to this article it says the first camera with this new sensor will be Sigma's SD9 SLR digital camera. No details on when, how much, what features. Anyone have more info on when this will be available? domo
I believe sex is highly over rated... unless it involves me
i think !?
When I went vegan over 10 years ago I chose to give up my darkroom (paper & film contain gelatine). I've been waiting in earnest for the photographic digital revolution!
Hopefully this will bring down the price of decent digital SLR cameras. All the ones I like the look of are about $1k and I've got too many other things on the list without burning a grand on a camera (+ a decent sized IBM microdrive + lenses etc.etc.)
I wonder if this will bring other benefits like clarity & shutter speeds available.
There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
High-end digital imaging devices (mostly digital and analog video cameras, but perhaps some still cameras) have been using 3 CCD chips for a long time to achieve RGB values for each pixel. It's usually done with a prism system that splits the incoming light into different colors which then are registered on different CCD chips.
In 1-chip devices, color is acheived through a matrix of filters which covers the CCD chip, allowing only certain wavelengths of light to reach each pixel on the CCD.
It seems to me that what this will really do is give us smaller, higher quality imaging devices. Let's hope X10 doesn't launch a while new popunder campaign...
is better than just higher resolution. If you just keep uping the resolution of the cameras, you also need to up the memory or use some lossy compression. With this tech (if it proves to be cost effective), you can keep your images to a reasonable size and make them clearer and better suited to using in print.
I'll believe it when I see it. Maybe in 2005. Or 2020.
-Martin
SoftMaker Office for Windows|Linux|Android
If anyone is interested how photography resolution compares to digital, I found a great link once about this: http://www.users.qwest.net/~rnclark/scandetail.htm
It's pretty eye-opening if you think digital photography is getting close to film.
Sometimes it's best to just let stupid people be stupid.
People will no longer be able to say "that's a really crappy picture of me, I actually look a lot like Ricky Martin's second cousin" anymore?
There's also a decent article on business2.com
http://www.business2.com/articles/web/print/0,165
Don't blame me - I voted for Howard Dean. http://dean2004.blogspot.com
Please check out superconducting tunnel junction technology, which is the basis for detectors that can measure the frequency of impinging photons. No need for separate RGB pixels - stacked or not - because each pixel can determine the exact frequency or wavelength of each photon it detects. You can take a spectrum and create an image in one exposure with one detector, without using any diffraction gratings or RGB filters.
Edith Keeler Must Die
There are already some (very high-end) digital cameras using CMOS technology, and judging on the sample images I've seen, they are awesome. Take a look at the review of Canon's EOS-D30, for example.
__
Zarathustra.fi
Modern man has no goal, no aim, no ideals.
Business 2.0 has a easy to understand graphic that explains how this new technology works in their article on Foveon's new chip. http://www.business2.com/articles/web/0,1653,37797 ,FF.html
Harris - seeking knowledge of a higher form...
Due to the sensor thickness, is depth of field going to be restricted to smaller stops in order to have the entire thickness of the sensor in focus?
*whup* "Get along, little electrons. Heeyah!"
I'm sure it was -thought of- before, just that the technological hurdles were too difficult/expensive to overcome. After all, stacking circuits vertically is difficult to do.
I don't know the specifics, but I can easily look at everything else in technology. Just about everything is -conceived of- before someone actually manages to -build it-, and build it -cheap enough-. That's the reality of engineering.
It does go the other way -- new technical capability can cause people to think of things they wouldn't have before -- but as you say, the already evident facts of the situation make that unlikely.
The enemies of Democracy are
Not all film contains gelatin (no e), a quick google search turned up which types have it and which don't. Apparently it's only in the best looking film.
On a side note, does this mean you don't support most photographers or (non-digital) movies?
Interestingly, Contax just came out with what I believe is the first full-size sensor in a digital SLR, here's an article about it. But yeah full-size sensor, EOS lenses, in an SLR, that would rock! Oh yeah and it would be nice if it was under $1000...someday..
Question though: Why does someone (Nikon) not produce a truly modular upgradable digital SLR camera?
The D1 is a step in the right direction, but it's too big and way too expensive.
CCD's should be replacable like film backs on film cameras, so that you don't have to throw the whole camera away, just replace your 3Mp back with an 8, then a 12 etc.
And interchangable lenses, preferably standard F mount, for Christ's sakes people. You can't do serious photography with crappy builtin zooms.
My dream camera would be an updated Nikon F3, but with upgradable digital backs, and an option for an LCD screen, but not built in.
This is very cool technology. So cool that the photodetector array must be cooled to "well below 1 degree Kelvin" in order to operate. This requires a liquid helium cryostat. So don't expect this to appear in pocket sized cameras any time soon. But it sounds great for astronomy.
Doug Moen
I have written a truly remarkable program which this sig is too small to contain.
try reading the article, numb-nuts. Sigma is introducing the first camera based on a Foveon X3 in around two weeks time.
That was classic intercourse!
No, it's not a case of noone thinking of it before. It's simply the case that the engineering skill and knowledge to apply a known basic principle necessarily always lags behind the understanding of the basic physical properties.
Just think about it a minute. You've just discovered a new property of a substance. Does that mean you can just run out and start making new revolutionary things?
No, of course not, you still have to take the time to work out the engineering.
Certainly the most commonly known story of this phenomenon is the invention of the light bulb by Dr. Swan.
Oh, sorry. Most people don't know that story, they know the one about Edison, which actually further illustrates my point.
When a new basic principle is discovered there are generally thousands of people to whom the implications are patently evident, and the race is on to see who gets the credit for exploiting it first.
Swan actually demonstrated his light bulb before Edison did, and if Edison hadn't even bothered to try the light bulb would have been just as available in the exact same time frame. ( By the way, the same thing applies to the idea that Bill Gates is somehow personally responsible for the PC revolution).
But we DO pretty much all know the story of how Edison understood the basic principle involved, and how long it took, and the sacrifices he had to undergo, in order to learn how to *apply* that principle usefully.
N'cest pas?
KFG
WOW. I worked on a project trying to do some pretty accurate work with digital cameras, and I can tell you this... Until you spend around $20,000US, you will not even get close to your original. Heres an example.
The subject is a GretagMacbeth color checker (a bunch of square swatches of color with a black boarder)
With a pro-sumer camera, say around 3k, the image overall looks OK, but zoom in to any "grayscale" swatch, and you'll see that the image is still very much little RGB dots blurred together, and your grey never has all the same RGB vales as a true grey should.
As you go up to the 20k price range, a variety of tech is used to get more accurate color. The best I have seen was a back for a large format camera (can't remember the name for the life of me) that, when used in a studio setting only, could capture exact grey values for each pixel. What this means, is that if you took the captured image in to Photoshop, with no image correction, and you used the eyedropper over a grey swatch, your RGB values would read (x , x , x) over the whole swatch without a hiccup (1 pixel sample).
The camera achieved this by physically moving the CCD array so that it took something like 3 or 4 shots of the image (hence needing to be in a studio set up).
Now, a single CCD camera setup that can be used in the field, probably generating the same results as above, is going to be HUGE.
I don't know the target price range to start, but cameras using this tech, if it lives up to its promises will be HUGE in the pro photo field. Capturing a more true color vs. totally interpolated has enormous impact on color correction and manipulation images. In my experience, images for lower end cameras don't always manipulate in ways you expect because of the interpolated nature.
"Stuff... In my home!? NEVER!" - Zim on Invader Zim
"I want the toilet seat!" - Little Dog on Two Stupid Dogs
This thing could also make one heck of a nice nightvision system, if used properly... so we could all have nice color pictures at night, just like the military folks have had for a long time. (Green screens are just for the media to consume).
--Mike--
--Mike--
This is nice, and should lower the cost of digital cameras while improving the quality. But what ever happened to JPEG2000? I thought we were going to get a lot more pictures on our FlashCards but as far as I know, no one is yet shipping a JPG2K-enabled camera.
Parallax and other artifacts cause headaches in all forms of digital processing... causing countless software algorithms to be written that bring things back *inline*. This should do away with much of error correction in imaging.
Even in areas where we do noise removal and color balancing by additive techniques (e.g., image white through rgb sensors... negate it and use that as a additive mask to remove dirt, flys, etc... from your lens as well as color correct by printing the output and again subtracting that from the original to find unbalance in guns) - this will greatly improve the errors that abound surrounding such subtractive and additive region processing.
This will also reduce geometric distortion that often affects sensors where the RG and B components are split out and each sent to a different sensor (assuming that their RGB masks in this sensor are layered properly).
Very good work.
If I'm right in my assumption, it should be possible to build an arbitrary stack of layers (with reduced efficiency) for any color ranges you care to deal with. It might be possible to make a camera that has a special layer to pick up the 700nm wavelength that chlorophyll absorbs line to determine plant health for use in agriculture.
I suppose it could be stacked the other way, but that would probably be a much larger engineering challenge.
--Mike--
The reality will be, assuming the price on these sensors is competitive, that manufacturers will run the same crummy resolution, because Joe Consumer is amazingly happy already with 35mm ASA 400 and 800 quality prints, which look terrible after a lifetime of ASA 25 & 64 film use, not to mention medium format, which is the only plausible choice for quality poster size prints.
It's a neat technology, but I'm underwhelmed until it translates into a high enough resolution sensor in a body I can use my existing glass on for a price comparable to buying a 35mm body. Granted, you get the luxury of instant feedback on your photo (though there are drawbacks, i.e. on how fast these hi-res images process in the camera see my webpage for SF Grand Prix pictures for further explanation and examples), film is still fast and affordable. All I really need is a better way to transfer negatives or slides to my PC. I have an HP photo/slide/negative scanner, but it's unimpressive.
A feeling of having made the same mistake before: Deja Foobar
It's not just the resolution - it'll do away with the awful artifacts that are present on even the best of today's digital cameras.
Oolite: Elite-like game. For Mac, Linux and Windows
Yes, but having each one of those r g and b lcd cells be an entire rgb pixel would increase resolution even further! The fact that each pixel has to be one or more rgb triple pixel now only reduces the resolution of the monitor from what it could be if each lcd cell was an rgb pixel.
Contrary to popular belief, coding is not all free blow-jobs and beer. Those things cost MONEY!
It goes in the wish list, along with my personal KiloWatt, and personal MegaWatt, and the 10k*10k pixel CCD camera.
--Mike--
You might be interested in Fill Factory's goodies:
The FUGA is kinda cool in that it doesn't integrate like a CCD. It has no 'shutter time' and pixel values can be read on the fly.
The site has an excellent FAQ.
Blancmange
Actually there is a company producing a flat screen with lets call them nearly real color pixels. Rather than using filters in the panel they use extremely bright Red, Blue, and Green color LED's in the backlight. The image is then represented in a field seqntial fashion. The beauty is that each individual pixel is representing the full color, so you dont need silly and stupid gimmicks like cleartype.
Here's the link if anyone is interested:
LumiLeds
You just can't win...
I'm trying to teach myself to set people on fire with my mind... Is it hot in here?
Carver Mead (the driving force behind foveon) is one of the few true modern visionaries out there. He was not only the pioneer of AVLSI, and therefore responsible for the microchip boom in the 1970's, but also one of the first people to start seriously looking at making electronics more like biology.
Some men spend their entire lives trying to kill themselves for having been born. --Ross MacDonald
vegans just don't respect the life cycle of animals.
ok i'll bite
er, how is living in a crate part of the life cycle of a pig?
How is living 3 to a 2 foot cage the life cycle of a chicken?
Since when was having your children taken away unweaned and being drugged with hormones so you'll keep making milk part of the life cycle of a cow.
The trouble with country folk is they've lost touch with nature.
There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
2. See hypocrite.
how's that then?
There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
There are a couple of problems with logarithmic sensitivities in electronics- the little potential wells fill up too quickly. Make them too deep and they lose the low level light, make them too shallow and the electrons spill out.
Conventional AgX can capture around 14 stops of light (thats 2^14) - conventional paper can handle 8 stops or so... a typical scene has 2^11, give or take. Depends on the scene and the subject- obviously a shot of a barn with the door open in broad daylight is going to have a bit more range than a shot inside in a white room with light bouncing everywhere.
So, what you really want, is to have the SOFTWARE be cognizant of higher bitdepth images. When you have 8 bits to capture a 10 bit scene, information is lost. So you throw some out... and you end up with muddled highlights and muddled shadows, and something in the middle that looks decent.
Believe it or not, but alot of companies have spent alot of money trying to figure out the correct 'mental' representation of a greyscale- not even including colour. I'm partial to Kodak (I work there, but these views are mine).
I've worked with extended bit depth images quite a bit and know that there is none (read, big fat ZERO) ms support for anything over 8 bits.... in fact, ImageViewer simply locks up and crashes. So any sort of solution that gives you extended tonal rendering are going to have to be custom solutions... and that probably won't sit well with the average person- "what do you mean i have to process my pictures before I can view them?!?!? I'll just go buy another camera" etc etc. Even if the benefits are enormous, there is the simplicity factor that drives it.
I personally am interested in this sensor, but there seems to be the wrong website linked... which worries me...
The current leader is 16 megapixel made by Eastman Kodak, the sensor is 4080x4080 in a Bayer array, which means it has 16 million pixels. That creats an image that is 48 megabytes, or if you work in the raw mode 96 megabytes (since you need a 16bit dword to hold the 12 bit data).
Back in the late 1970s Carver Mead of CalTech and Lynn Conway of Xerox PARC computerized the design of integrated circuit chips. Before them chips were designed by mechanical drawing and hand-taped photo-masks. This often resulted in spaghetti-looking chip circuits. Mead & Conway reduced chip design to a hierachical set of physics and geometry issues, and wrote a compiler to issue these from higher level descriptions. Chip design was then transformed more-or-less into a computer language. People then added optimization and simulation-testing tools to further automate the process. It got so simple that chip design labs were offered in engineering colleges with same-semester turn-around. Some guy in my class twenty years ago designed a "homogeneous coordinate multiplier" which become the geometry engine of a startup called Silicon Graphics.
If you design your system to make the GretagMacbeth checker to look good, it will most likely make reality look bad.
;)
Personally, I prefer reality
Theoretically some cameras split light onto 3 CCDs so the RGB component on each CCD is spacially equivalent. Some projectors merge 3 CRT's so the image projection for each component is spacially equivalent. The problem is these mechanisms aren't very heavily marketed for consumers. Foveon is the first to sell to consumers.
35mm image to 40x60 print at 400dpi. You do the math on how many pixels that is the equivelant of... ;) (hint: you don't need the 35mm size in the calculation...)
Sitting on the shelf behind me is a colour portrait of yours truly taken with a Foveon prototype at the Telecosm Conference in San Francisco late last year. It's a head-and-shoulders shot about 8 inches by 6 which rolled out of their high-end photo printer about thirty seconds after they took it.
:-)
I didn't brush my hair very well that day, and you can see every individual sticking-out hair reflecting the light. You can see the worry lines on my forehead, despite the fact that I'm only 23, and you can see the rest of the room reflected in my eyes.
It's amazing.
Gerv
I don't know what exactly they've patented regarding "Variable Pixel Scale" technology, but it sounds like "binning" to me. We've been doing that in astronomy with CCDs for years. I can envision it now, a cease-and-desist next time I'm on Mauna Kea.
Have you heard of Pixim?
http://www.pixim.com/pt/pt_dps.htm
They are working on a new technology to replace CCD, to answer your question.
Claimed on their website: DPS technology, in contrast, intelligently combines both image capture and image processing into a single system, which allows for both design simplicity and improved image quality. By marrying the quality of CCDs, the low-cost, mass production capabilities of CMOS and the power of image processing in a single system, Pixim's DPS platform revolutionizes image-making in both video and still cameras.
From what I gather, it's a way of measuring light directly onto a chip, without having to go through the CCD process. Sounds good to me. Hopefully it will make it so digital cameras don't drink batteries :-)
Dr. Demento On The 'Net!
I'm a bit worried about how well this will differentiate colours - the colour filtering is pretty crude - i.e. how far the penetrates the silicon. Almost certainly this will be a mean-free-path like dependency - the amount of light penetrating to a given depth will drop exponentially with depth, but with a different characteristic length. (Substitute time for depth and you have the radioactive decay half-life situation.)
.8B + .5G + .2R
.16B + .25G + .16R
.032B + .125G + .128R
.800B .500G .200R
.192B .375G .288R
.008B .125G .512R
The situation is likely to be something like this: Each layer absorbs (and therefore counts) 80% of the blue light, 50% of the green light and 20% of the red light*. So if the incoming intensities are R, G and B then:
1st layer counts
2nd layer counts
3rd layer counts
So to disentagle the actual R, G, B values, it will be necessary to solve a set if simultaneous equations. This process will introduce substantial extra noise into the colour values.
(Another way of saying this is that the colour/response curves for each layer is quite broad.)
*This example is simpler than the real situation is likely to be, e.g. we can improve things if we make the 2nd layer twice as thick and the 3rd layer 'infinitely' thick, then we get:
Layer 1:
Layer 2:
Layer 3:
which gives better colour differentiation, but no matter what we do, it will always be a mixture in each layer.
Quattuor res in hoc mundo sanctae sunt: libri, liberi, libertas et liberalitas.
Format is not function.
If you don't understand the difference between colour space and format of the data, you really don't need to post a response to either this or the previously mentioned topic. Because you don't understand it, may I reccommend a book, Digital Encoding Solutions, available from Amazon for around $45.
Using CMOS sensors, it is possible to get both linear and logarithmic responses from pixels, depending on your biasing conditions.
For a linear sensor, the photosite is generally a floating N+ diffusion, that makes up one side of an NMOS transistor. At reset, the voltage here is set to VDD. As incident light generates electron-hole pairs, the electrons are collected in the diffusion, lowering the voltage in a linear fashion, dependent upon the parasitic capacitance of the photosite. When the integration time is up, this charge/voltage is sampled, and you have a linear sensor.
For logarithmic response, the reset level of the photosite is actually even with the biasing of the gate to that transistor (minus the Vt, of course). Incident light generates electrons, and the transistor operates in the sub-threshold region, making the voltage at the photosite vary as the logarithm of the current being generated and flowing through the gate region. Sample that voltage, and tah-dah, you've got a logarithmic response to light.
I admit, this is much easier to understand with diagrams of the diffusions, so if you want, here is a pdf of a paper discussing a sensor that has combined linear-logarithmic response:
CMOS Active Pixel Sensor With Combined Linear and Logarithmic Mode Operation
It may look like I'm doing nothing, but I'm actively waiting for my problems to go away.
--Scott Adams
They have patented this:
= PT O2&Sect2=HITOFF&p=1&u=/netahtml/search-bool.html&r =3&f=G&l=50&co1=AND&d=ft00&s1='5,965,875'&OS="5,96 5,875"&RS="5,965,875"
United States Patent number 5,965,875
"Color separation in an active pixel cell imaging array using a triple-well structure"
It's on uspto.gov here:
http://patft.uspto.gov/netacgi/nph-Parser?Sect1