Slashdot Mirror


The Real Reason why Spirit Only Sees Red

use_compress writes To produce a color photograph, the rover's panoramic camera takes three black-and-white images of a scene, once with a red filter, once with a green filter and once with a blue filter. Each is then tinted with the color of the filter, and the three are combined into a color image. In assembling the Spirit photographs, however, the scientists used an image taken with an infrared filter, not the red filter (NYTimes, Free Registration Required). Some blue pigments like the cobalt in the rover color chip also emit this longer-wavelength light, which is not visible to the human eye."

44 of 273 comments (clear)

  1. Was in New Scientist a week or so ago by Space+cowboy · · Score: 5, Insightful

    The reason being that the science gets better results using th e IR filter than if the red filter were used... At the moment, despite great public interest, the science is more important... that IS what it's there for....

    Simon

    --
    Physicists get Hadrons!
    1. Re:Was in New Scientist a week or so ago by SpinyManiac · · Score: 4, Informative

      Not just that, using a B/W camera allows them to use any filter they like.

      They have at least 14 filters, taking 14 cameras would be impossible.

      Info here.

      --
      It's never too late to have a happy childhood.
    2. Re:Was in New Scientist a week or so ago by mcbevin · · Score: 5, Informative

      If you read the whole article, you'd see that they actually used both the infrared AND the red filter for the pictures. So they had their infrared for their science as well as the red for the photos to show the public. However they mucked up in producing the photos for the public, using the infrared instead of the red. Nothing to do with science vs public interest, rather a simple mistake.

    3. Re:Was in New Scientist a week or so ago by SnowZero · · Score: 4, Insightful

      And it was on NASA's site almost two weeks ago:
      Revealing Mars' True Colors: Part One
      Revealing Mars' True Colors: Part Two
      Nothing to see here, take off the tinfoil hat.

  2. Cue a thousand alien-watcher website updates.. by Channard · · Score: 5, Funny

    'Aha! So that's why they don't see little green men...' - at last, the dream of aliens living on Mars is alive again.

  3. obligatory registration free link... by corsetboy · · Score: 5, Informative
  4. prepare the servers for a nytimes-dotting... by mobiux · · Score: 5, Funny

    They mention slashdot.org by name.

    Could this be some sort of revenge?

    1. Re:prepare the servers for a nytimes-dotting... by arcanumas · · Score: 4, Interesting

      If they wanted to take their revange they would have made it a link. Now, it is just text and most people don't like copy-pasting.
      But they mention that "As Mars buffs have pointed out in recent weeks on Web sites like Slashdot.org" , i wonder if they read Slashdot because they like it or just to see why an ungodly amount of refferer logs says: slashdot.org

      --
      Slashdot Sig. version 0.1alpha. Use at your own risk.
    2. Re:prepare the servers for a nytimes-dotting... by Asprin · · Score: 5, Funny


      Quick! Put up the free registration page!

      --
      "Lawyers are for sucks."
      - Doug McKenzie
    3. Re:prepare the servers for a nytimes-dotting... by lukewarmfusion · · Score: 5, Funny

      Then NYTimes will have to link to the Google cache, someone will copy and paste the unformatted text on their site anyway, and we'll see a plagiarizing reporter trying to karma whore in order to get his job back.

      Of course you know.... this means war.

  5. Why b/w & filter? by Lolaine · · Score: 5, Interesting

    Can anyone explain why 3 separate B/W images are taken? If it is because of bandwidth... 3 grayscale images weights (more or less) like one color image ... so why B/W and filters?

    --
    ------- The last Sig. got fired.
    1. Re:Why b/w & filter? by anubi · · Score: 4, Informative
      I understand its because its a heckuva lot easier to build high resolution cameras as monochrome, as you can place the pixels immediately adjacent to each other and not concern yourself with placement of color filter masks.

      Also, having external color filter masks which can be rotated into place means we are no longer limited in vision to just the visible spectrum we see, but we can see anything the raw silicon sensor allows, meaning we can also view the infrared to ultraviolet, and let us assign "pseudo color" as we see fit.

      --
      "Prove all things; hold fast that which is good." [KJV: I Thessalonians 5:21]

    2. Re:Why b/w & filter? by richie2000 · · Score: 3, Informative
      My guess is that it's easier to get more resolution out of the camera this way. You can use the full resolution for every colour instead of having 4 sensors (RGB + IR) on-chip per pixel. More on the MER cameras here

      I can still remember using a NewTek DigiView digitizer with a b/w video camera and filters so I guess the Alzheimer hasn't gotten to me yet. :-)

      --
      Money for nothing, pix for free
    3. Re:Why b/w & filter? by EvilTwinSkippy · · Score: 4, Informative
      They are sending the raw picture uncompressed. Well, they might use a run-length encoding, but the result is a lossless image. JPEG is so much smaller because it really cuts corners, and exploits the fact that our eyes are more sensitive to contrast than the magnetude difference between colors.

      With scientific imaging, OTOH, you want the raw information coming off the CCD. They are interested in everything, not just what the human eye can see.

      So, with lossless encoded, 3 greyscale images actually come out to be the same size as a color image. (Look at a color TIFF for example.) The advantage of the B/W and filter approach is that you need only one capture device. On a spacecraft there are many design advantages. Besides, you now have 3 copies of the same image. You never know when one copy will pick something up that the others missed.

      --
      "Learning is not compulsory... neither is survival."
      --Dr.W.Edwards Deming
    4. Re:Why b/w & filter? by mhollis · · Score: 4, Informative

      Essentially, that's what all professional cameras do.

      A broadcast television camera (which is really pretty low-resolution, unless it's a true HTDV camera) has three CCD sensors mounted to a prisim block that splits the image into the three component colors for television (RGB). The use of three CCDs for television is necessitated by the fact that the desired result is a color image without waiting to assemble a color composite from three black and whites. Broadcast television results in images that are pretty close to 640x480 (again, prety low res).

      The MER images are stills. As such, there is time to put together a composite of the separate components taken with the filters. The data desired is high resolution and each of the composite images (irRGB) yields different information. Additionally, JPL is not lacking computer time for assembling the result of the component images. We're not talking live video feeds here.

      I note that there has been some discussion of weight here. That is not a factor in this case. Each of the filters, together with the CCD and the precise movement motor probably weighs about the same as a three CCD system, but in this case, it is one CCD, so any defects can be known and programmed around so there are no trade-offs. The issues JPL/NASA are dealing with have more to do with the size of the data sets and the available time in which the MERs can communicate with Earth.

      --
      Gods don't kill people, people with gods kill people.
    5. Re:Why b/w & filter? by herko_cl · · Score: 5, Informative

      Sorry to say this, but the parent in NOT "Informative". The only sensors with 3 photosites per pixel are Foveon's. The vast majority of digital cameras has ONE photosite per pixel, and a Bayer mask (RGB filter) layered on top of it. Pixel color in the final image is then interpolated from the measured intensity of the three adjacent photosites. Yes, this means that digital cameras have higher Luma resoultion than Chroma. No, it does not matter much, because the eye is much more attracted to Luminance detail.
      Almost all of the manufactured sensors are black and white; only Foveon's are 3-color, and they're expensive for the resoultion and the first generation software had color clipping problems (overexposed areas of images went abruptly to white). This has apparently been fixed.
      A monochrome sensor with external filters is much more flexible than the single-duty Foveon, so I guess that's why they chose it. Also, NASA doesn't usually buy space-faring hardware off-the-shelf two weeks before launch, and this full-color sensor simply did not exist a couple of years ago.

      --
      No .sig for you! ONE YEAR!
    6. Re:Why b/w & filter? by mdielmann · · Score: 4, Informative

      Note also that color CCDs aren't actually color, but a B/W CCD (There really isn't a such thing as a color CCD) with 3 different color filters applied pixel-by-pixel. This has the drawback of interpolation, and the collection of 1/3 of the raw data. The only way to get true color is to use either 3 (or more, depending on what you want to see) CCDs with an image splitter so they all see the same thing, or a series of filters, with each color taken in turn. Guess which one is smaller.

      --
      Sure I'm paranoid, but am I paranoid enough?
    7. Re:Why b/w & filter? by gujju · · Score: 3, Informative

      Just for the parents information. This technique only works when the camera and the subject being photographed are not in motion. If they are in motion then, in the time it takes to switch filters, the picture would have changed and then you wouldnt be able to composite them together accurately.
      Gujju

    8. Re:Why b/w & filter? by vofka · · Score: 5, Informative

      A broadcast television camera (which is really pretty low-resolution, unless it's a true HTDV camera) has three CCD sensors mounted to a prisim block that splits the image into the three component colors for television (RGB). The use of three CCDs for television is necessitated by the fact that the desired result is a color image without waiting to assemble a color composite from three black and whites. Broadcast television results in images that are pretty close to 640x480 (again, prety low res).

      Close, but not quite...

      A Broadcast Quality camera is usually capable of recording a substantially higher resolution of image than is eventually broadcast. This allows for much better editing facilities later on - ie. Cropping and resizing of the recorded images without loss of detail in the later broadcast. Final Broadcast (in the UK at least) is around 760x575 pixels (actual broadcast lines are 625, but several are taken by the Vertical Blanking Pulse, the Frame Field Markers and Teletext data) - but the camera definately records a much higher resolution than that.

      For comparison, a standard Hi-8 Domestic Hand Camera records around 540 picture lines (about 720x540), and the picture quality from this kind of camera is much lower than that needed by the broadcast editing suites to work effectively - just watch any "home video" programme (such as "You've been Framed!") for proof!

      Also, expensive professional broadcast cameras use "Dichromatic Mirrors", not prisms to do colour seperation. Prismatic seperation would lead to too much signal loss and colour bleed accross the image. The first mirror directs the Red image to the appropriate sensor, and also allows enough light of all wavelengths to pass to the next mirror, where the Green image is diverted to the appropriate sensor, and again, light of all wavelengths passes to the final sensor in the camera. Blue is never explicitly seperated from the incoming image, but is instead inferred from the intensity data from the three individual sensors.

      I can be very certain of both of these facts because my dad was a Video Electronics Engineer for the BBC for a number of years...

      --
      Disclaimer: I meant what I thought, not what I wrote! What? You can't read my Mind? Oh dear!
    9. Re:Why b/w & filter? by SnowZero · · Score: 4, Informative

      Well, they did say "bundle like a TV" which is correct, but they did mistakenly call that one pixel. For all practical purposes Bayer filters are lying about the resolution and you might as well call the 2x2 block a single color pixel.

      Foveon's sensors don't have really good color separation, and NASA wanted to have more than RGB anyway (they actually have something like 14 different filters). For science you don't want to limit yourself to just the visible spectrum. Hubble works similarly.

  6. Science, not reality TV by kinnell · · Score: 3, Funny

    It's a good job the pictures aren't coming back with a blue tint, or lynch mobs would be turning up at NASA HQ.

    --
    If I seem short sighted, it is because I stand on the shoulders of midgets
  7. Short version by the_crowbar · · Score: 4, Informative

    On the panoramic picture: We goofed. It should not have been that red.

    The other photographs are taken with the infa-red instead of visible red filter. Iron dominated the visible red spectrum. To allow a better analysis of the compounds found infa-red light is used instead.

    <joke>No conspiracy here. Move on.</joke>

    the_crowbar
    --
    Have you read the Moderator Guidelines
  8. Gameboy Camera Color by drfishy · · Score: 3, Funny

    Reminds me of the Gameboy Camera Color Project: http://www.ruleofthirds.com/gameboy/

  9. Re:Why don't they release the RGB too? by Anonymous Coward · · Score: 4, Informative

    They release all the individual raw pictures on the mars rovers website. You are free to composite them yourself.

    The engineers are focusing on the filters that return good science.

  10. Re:Why don't they release the RGB too? by Seahawk · · Score: 4, Informative

    ALL data IS actually released.

    Cant remember links from the top of my head(Search older /. stories), but several people have taken the raw data and composed their own versions of the colour photos.

    AFAIR the things is a bit more complicated though - the cameras have 7 different filters, which have quite a bit of overlap, and doesnt peak at frequencies of light that directly could be used in an RGB image - so some fiddling is requered.

    And TBH - I think its perfectly fine NASA doesn't focus on producing "correct" images if it doesn't mean better science! :)

  11. Versatility by Detritus · · Score: 4, Insightful
    Instead of being limited to some fixed approximations of red, green, and blue, they can use a larger set of filters that are tailored for various science objectives.

    The human eye's color vision is a poor scientific instrument. It can be easily fooled.

    --
    Mea navis aericumbens anguillis abundat
  12. Re:Why don't they... by Carl+T · · Score: 5, Interesting
    [...] just use a 4 megapixel digital camera that anyone can buy from Compusa

    Quite possibly because it wouldn't survive the conditions on Mars. Or on the way there. Try deep-freezing your digital camera, then put it in a vacuum chamber, then in a really dusty sandbox, and finally subject it to a potentially lethal (for a human) dose of radiation, and see if it still works. Oh, and don't forget simulating the landing; heat it, vibrate it, and toss it on the ground.

    Disclaimer: I wasn't there. I don't know exactly how the poor thing was treated. I'm not a member of the PETC (People for the Ethical Treatment of Cameras).

    --

    This signature is not in the public domain.
  13. Partner Link by HFShadow · · Score: 4, Informative
  14. Re:Why don't they... by Lumpy · · Score: 4, Interesting

    because that 4 megapixel camera from comp usa is a total piece of crap compared to the 1 megapixel B&W camera on the rover.

    I have a old 2 megapixel digital camera that will beat the Best 4-6 megapixel consumer camera you can buy today. because of optics and the design of the CCD. (mine is a TRUE 2 megapixel whereas almost ALL camera's today sold as a 4 megapixel are really a 1.3 megapixel camera as you need 3 pixels for each photographed pixel.. (I.E. one for red,green and blue.)) plus the resolution of each color captured is vastly different, green usually being the best resolution while blue suffer's the most..

    Nasa is not about to send the really low grade crap that is available to the cunsumer to another planet. they sent the real deal.

    I suggest you actually learn about digital photography and why consumer grade "cameras" are utter junk.

    --
    Do not look at laser with remaining good eye.
  15. Re:Blue? Infrared? by dwm · · Score: 3, Informative

    A material can emit light at various wavelengths, and at wavelengths quite different than that which it reflects, which is what you most commonly see in the visible range. It's quite possible for something to reflect blue light and emit light at wavelengths longer than the visible range.

  16. Re:Blue? Infrared? by Bill_Mische · · Score: 4, Informative

    I'd imagine because the blue colour corresponds to an electron transition in the d-orbital whereas the IR corresponds to a different transition or more likely to a change in mode of molecular vibration.

    One of the few things I remember from my chemistry degree was that many pigments are far brighter in the UV region since the "normal" colour corresponds to a forbidden transition - i.e. one that involves a change of spin as well as change of orbital.

    I do hope that wasn't a rhetorical question...

    --
    Boring Old Fart (40, married, 3 kids...er no...make that 49, married, 3 grown up kids...it's been a long time)
  17. Re:Why don't they release the RGB too? by mlyle · · Score: 4, Informative

    My site was one of the past ones featured on Slashdot.

    Unfortunately, all data isn't released. There is not radiometric data or pointing data for pictures, spectrometer data, etc.

    And NASA puts a hold on images they plan to use later for press conferences-- e.g. the individual PanCam pictures of the parachute and backshell weren't released. This goes directly against the promises they made pre-mission.

  18. But what is this thing? by tjmcgee · · Score: 5, Interesting

    The martian crab http://homepage.mac.com/thomasmcgee/ I know, I know, go ahead, mod me off topic. The truth is out there. Would anyone like to start a petition that requests NASA to try to get one more photo of this thing before they drive away?

    1. Re:But what is this thing? by SnowZero · · Score: 3, Funny

      Yeah, but how does this compare to the penguin worship formations we already know are there? That "crab" looks more like a "martian booger" to me.

  19. Re:before shooting comments off the hip about IR by jandrese · · Score: 3, Interesting

    I don't know if my camera has a cheap filter or no filter at all, but it is more sensitive to infared than the naked eye. The easiest way to see this is to point a remote control at the camera, hold down a button and snap a picture. In the picture you can see the little bulb in the remote all lit up, even though it is invisble to the naked eye.

    --

    I read the internet for the articles.
  20. I've often wondered by ajs318 · · Score: 3, Interesting

    I've often wondered exactly how rigid the "400-700nm is visible" rule applies. We know that some animals can see infra-red and ultra-violet. But just how well-defined is the wavelength range for human beings? I mean, our bodies are different shapes and sizes, our voices have different pitches, our ears have varying ranges, some of us are allergic to certain substances that others are not ..... but has anyone ever investigated the phenomenon of what wavelengths humans can see? Is it a person-to-person variable, or is it constant for everyone? Can some people see IR, red and green, for instance, instead of red, green and blue? Or green, blue and UV, for that matter ..... and what would it look like?

    --
    Je fume. Tu fumes. Nous fûmes!
    1. Re:I've often wondered by sugar+and+acid · · Score: 4, Interesting

      A way of dealling with blindness from cataracts (the lens of the eye turning opaque), is to remove the lens of the eye and replace it with an artificial lens. An interesting side effect is that without the lens people can see further into the UV region of light.

      Interestingly the work of Claude Monet demonstrates this. Starting with his early work which is clear and in the normal colour range, then he develops cataracts and his work is more undefined swirls of colour, often dark and dim. Then he has cataract surgery and the new work is bright and vibrant, but with a deep purple/blue hue to many things because of the now increased presence of UV light in his vision.

  21. Magic Lantern by KaiBeezy · · Score: 3, Informative

    When you take a look at what this old-tech can really do, it's quite astounding.

    The Library of Congress has an exhibition of pre-WWI (that's World War I) *color* photos of Russia shot using the exact same process. Since this was a while before any practical color photo printing processes the photographer built a "magic lantern" for "optical color projections."

    Props to Bolo Boffin for the link.

  22. From the horses mouth by RetroGeek · · Score: 3, Informative

    Read this and this. These are from the NASA Rover site and they explain it all.

    --

    - - - - - - - - - - -
    I am a programmer. I am paid to produce syntax not grammar. Deal with it.
  23. Re:Why don't they release the RGB too? by robsimmon · · Score: 3, Insightful

    I would guess (based on my experience with other NASA data archives) that the full scientific data are not being released until they've been calibrated, at which point they'll probably end up in the Planetary Data System It's also possible that the Principle Investigators (who are affiliated with Cornell, not NASA) have exclusive use of the data for some period of time. Scientists are often very reluctant to share data until they're happy with it. Whether this is good public policy (since the data was all paid for by the US public) or good science is open to debate, but it's certainly not a conspiracy.

    In the case of the more dramatic images, Public Affairs is almost certainly embargoing the images so the press release will (in theory) have more impact. If you really want the data you can always try a Freedom of Information Act request.

  24. Prokudin-Gorskii by rkenski · · Score: 3, Informative

    Prokudin-Gorskii travelled Russia taking color photos about a hundred years ago, a time when there was no color films. He used to take 3 pictures, one after another, each one with a different filter. He then projected the three together to get a color picture. Similar to Spirit but in a very, very old fashion.

  25. Re:Why not just give NEW pictures! by BiggyP · · Score: 3, Interesting

    so, i threw this one together the other day, is it anywhere close do you guys reckon?

    Spirit-pano-rgb-compose.jpg

  26. Approximation has been going on for decades by Tablizer · · Score: 3, Informative

    Pioneer 10 and 11, which both flew past Jupiter in the mid 70's, used only a red and blue-green filter IIRC. They used these two colors to approximate full-color images based on earth-bound images. I don't remember anybody fussing about it back then. A disclaimer of sorts was usually in the more technical articles, but many articles said nothing about it.

  27. Re:Why not just give NEW pictures! by daina · · Score: 5, Interesting
    It is a misconception that you can use Photoshop or some other image processing program to produce a "true colour" or RGB image when one channel represents infrared data. Here's why:

    If you use an infrared filter like the L2 filter on Sprit's Pancam, you get data that represents only things which reflect or emit light in that particular region of the spectrum. Anything that emits light ONLY in the red will be absent from the data set. It is possible for something that appears as a fairly monochromatic red to be entirely invisible. How can you use Photoshop to put back something that is invisible? You cannot.

    You can adjust an individual colour in the image using a reference image taken with the appropriate filters, and that colour will then appear correct. Other colours, however, will remain distorted.

    Worse, you cannot possibly know the emission/reflectivity spectrum of things on Mars, so any image you produce that appears to show the sundial colour chips correctly may distort terribly the Mars components of the image. It is not really very interesting to see a colour corrected photo of the sundial, is it? We could have achieved that without sending the rover all the way to Mars.

    Nope, using a relatively narrow-band-pass infrared filter like the L2 simply leaves out information about the red part of the spectrum, and extrapolation only goes so far in recreating that data. Non-linear data - discontinuities within the missing portion of the spectrum - are simply gone, never to be retrieved.

    Also, NASA is lying. Perhaps 'lying' is too strong a word, but they are either deceiving us or they are operating under a serious misconception.

    "We just made a mistake," said Dr. James F. Bell III, the lead scientist for the camera. "It's really just a mess-up." Well, NASA claims to be releasing the raw data from Spirit on its web site, but the raw data does not contain any image sets for the panoramas taken with the L4, L5, L6 filters. They have almost never used the L4 filter.

    So either the "mess up" is that they have forgotten to use the L4 filter from day one (unlikely, since each photograph taken presents another opportunity to switch to the L4) or that they have L4 images but they are not releasing them, in which case they really are not releasing the raw data.

    The argument about the L2 being better for science is bogus. There's no way that NASA scientists are doing serious mineral analysis with a pretty, stitched-together wide view panorama. That's just rubbish. they would be looking at detail images, and possibly comparing between detail-level images. The panoramas are strictly for public consumption, and maybe office posters at JPL.

    It's probably not a conspiracy, but it is a mystery.