Slashdot Mirror


Fermilab Builds 500-Megapixel Camera

heyitsme writes "Fermilab, a U.S. Department of Energy research lab, is part of a collaboration on an experiment to measure the properties of dark energy. The Dark Energy Survey would measure the history of the expansion rate of the universe more precisely than ever before, using the largest camera ever built with Charge Coupled Devices (CCD). The 500 megapixel Dark Energy Camera (DECam) would be placed on an existing 4-meter telescope located in north-central Chile at the National Optical Astronomy Observatory's Cerro Tololo Inter-American Observatory. The DECam together with the CTIO 4-meter telescope will allow for a survey of 15 percent of the sky to light levels faint enough to measure the colors of galaxies at redshift one."

48 of 180 comments (clear)

  1. Filesize? by FSWKU · · Score: 4, Interesting

    I would hate to see how much space one frame from this thing takes up...

    --
    "So after all this, you make my case for me. To end this stalemate, you must die..."
    1. Re:Filesize? by Anonymous Coward · · Score: 5, Informative

      The detector actually contains roughly 503,316,480 raw pixels, this amounts to slightly less than 500,000,000 effective pixels after initial processing.

      The data will, of course, be stored directly to a large SAN storage system, probably from EMC or Hitachi.

      The detector should generate single frame images of roughly 1.7G prior to post-processing, and roughly 700M single-frame image files after processing to TIFF or PNG format.

    2. Re:Filesize? by hyc · · Score: 4, Informative
      Interesting, the numbers you show don't appear anywhere in the article. Instead, I see:
      At the heart of the DECam are 60 rectangular (2k x 4k) CCDs, each with 8 million 15-micron pixels. The CCDs, developed at Lawrence Berkeley National Laboratory, are over five times more sensitive at near-infrared wavelengths than conventional CCDs currently used for astronomy.
      60 CCDs at 8 million pixels each for a total of only 480 million pixels. There's no mention of color filtration so grayscale is a safe assumption. There's also no mention of resolution but 16 bits sounds good as a guess.

      So 960 million bytes per frame, which is only 915.5MB (1M = 2^20).

      --
      -- *My* journal is more interesting than *yours*...
    3. Re:Filesize? by BWJones · · Score: 3, Informative

      Ummmm......I think it is too late and past my bed time. A quick rechecking of the numbers reveals a total of 960000000 bytes for each image in a 4800000000 pixel array giving us a much more manageable total of approx .9GB/image in raw form (again, assuming a 16 bit image).

      --
      Visit Jonesblog and say hello.
    4. Re:Filesize? by BWJones · · Score: 5, Interesting

      I have heard that some sites are planning a huge SneakerNet (or, rather, JumboNet? CessnaNet?) and hoping to fly out stacks of DAT tapes of the unreduced data back "home."

      So, we here in academia are a bit spoiled in terms of bandwidth. However, companies and some in academics have to pay for lots of bits and bytes and are thus interested in costs to move these sorts of data. I was talking with Jim Gray a couple of weeks ago and he was telling me that a recent study revealed some of the true costs of moving lots of data. For instance: Lets say you are trying to move a terabyte of data from London to Los Angeles. It turns out it is cheaper (and faster) to put it on magnetic storage and fly it from London to Los Angeles than it is to try and move it over the Internet.

      --
      Visit Jonesblog and say hello.
    5. Re:Filesize? by Hittite+Creosote · · Score: 3, Informative
      There's no mention of color filtration so grayscale is a safe assumption.

      Not in the article, but in their submission of proposal to Fermilab PAC, they state

      The total number of images over all bandpasses is 35.
      So, not more data per image, just more images.
    6. Re:Filesize? by BiggerIsBetter · · Score: 2, Insightful

      I believe that, but I've always had trouble with the cost of moving data around the Internet. I mean, it's not like fibre optic cable wears out faster the more bits you push through it. It seems to be more about supply/demand than any "real" factors.

      --
      Forget thrust, drag, lift and weight. Airplanes fly because of money.
    7. Re:Filesize? by hildaur · · Score: 2, Informative

      In fact, the Sloan Digital Sky Survey (in which Fermilab also plays a major role) transfers its imaging data from the the observatory to Fermilab (where it is reduced) by FedExing DLT tapes. I do not know what it planned for the DEC.

    8. Re:Filesize? by silas_moeckel · · Score: 2, Insightful

      I call BS, I can get a gigabit pipe in any major city for 10k a month. Assuming I just have two points I need to move data to thats 20k a month and I'm staying on the same backbone provider so I have contractual levverage is I cant get the throughput inside the one backbone. I can move 1TB is 8000+ seconds aka less than 3 hours. It takes nearly a day to get from LA to London as well with a ticket cost of what 2k on expedia booked a month out for an overnight trip. If you have to move a TB a day thats 60k in flights. FedEX is cheaper by far but so is provisioning a lamda on fiber and runnign your own routers. A hundred meagabit pipe is only a couple k for the two ends and moves a TB in a day about the same cost as the one plane ticket.

      Tapes have there place and for this instance it might make sence not to dump the capital into running fiber out but I would think it would since a telescope isnt a short term project. Tapes are good at getting data to different endpoints since fedex goes just about everywhere. The other thing you have to consider is accademics writing papers generaly dont have a clue how to find a good price on bandwith most people dont, companies are still selling at the 200+ a meg pricepoint when they have competiors in the teens. Bandwith is an artificial market controled by telco's with a very low real costs.

      --
      No sir I dont like it.
    9. Re:Filesize? by thedillybar · · Score: 2, Insightful
      If you have to move a TB a day

      Well, sure. But what if you only need to move 1 TB? On 1 day?

    10. Re:Filesize? by V_M_Smith · · Score: 2, Informative

      TIFF or PNG? Who in the world uses anything other than FITS for astronomical images?

    11. Re:Filesize? by Roger+W+Moore · · Score: 2, Insightful
      It turns out it is cheaper (and faster) to put it on magnetic storage and fly it from London to Los Angeles than it is to try and move it over the Internet.

      Until you remember that you have to pay someone to feed the hundreds of tapes into drives to copy the data to disk and that you'd have to buy and run well over 10 drives in order to get the bandwidth of a 10Gbit connection and a lot more into order to beat that bandwidth. I think if you worked out the cost and time disk-to-disk the result would be more favourable toward the network scenario.

  2. I'm glad by toddhunter · · Score: 5, Funny

    That they were able to save money by using an existing telescope.
    Because the compact flash cards for this thing cannot be cheap.

    1. Re:I'm glad by jensen404 · · Score: 2, Informative

      You could fit a few pictures on this 12GB CF:
      http://www.dpreview.com/news/0405/04052601pre tec12 gb.asp

      Only $14,900

  3. but by trs9000 · · Score: 2, Funny

    cool but does it fit in my pocket?
    im going to japan soon and i need a good camera......

    1. Re:but by JaredOfEuropa · · Score: 2, Funny
      im going to japan soon and i need a good camera......
      Buy one there on the cheap :)
      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
    2. Re:but by supergiovane · · Score: 5, Funny

      I dont't know that, but I heard that it has quite good lenses and an amazing zoom. You really don't need to go to Japan with it: you can take detailed photos of Japan directly from home!

      --
      Signatures are for stupids.
  4. 500 megapixel?? by fodi · · Score: 5, Funny

    I dont EVER want to be photographed in that much detail !!

  5. Ah to open this bad boy... by Xuranova · · Score: 2, Funny

    in Photoshop, it be a sight to behold. Or even better, embed one of these pics in a pdf file and EMAIL it to a friend. Ah yes good times for admins, systems, and users everywhere to enjoy!

    --
    "There is no real right or wrong, just what the majority accepts at the time."
  6. why you need 500 Mpx by sdedeo · · Score: 5, Informative

    (Not an expert, they're all fast asleep right now.)

    One of the things Fermilab is trying to do is get a measurement of the so called weak lensing effect. Matter distorts spacetime, and light is thus bent as it passes nearby a big cluster. This is gravitational lensing.

    Famously, it is seen as "strong" lensing -- when the source is very close on the sky to the cluster, and the light gets bent enough that there are multiple images. Nobody really believed it could happen, but then in the last decade or so it's become an accepted and popular thing to play with and observe.

    Weak lensing is when there are no multiple images, and instead only a slight distortion. Much harder to see and measure -- you basically look for a whole bunch of galaxies that are slightly distorted.

    That means you need a very wide field of view -- to get enough galaxies quickly enough -- but also a very good resolution -- to be able to measure the slight distortions. Hence the need for such an insane[ly cool] device.

    Why go through all this trouble? Well, weak lensing is one of the view ways to measure all the matter in the universe on very large scales. Because nearly all the matter is supposed to be invisible, in the past people have used various "tracers" that we can see. But there's a huge amount of debate as to how good the various tracers are, and, of course, you need a direct measurement to be sure you're not off in la-la land.

    Weak lensing measures it all because all matter, regardless of how bright it is, bends spacetime in the same fashion. So, if you can get a good weak lensing measurement, you can theoretically create an unbiased map of the matter distribution. No need to cross your fingers and hope that some tracer is behaving properly.

    It all fits into dark energy because dark energy is supposed to alter the extent to which matter can cluster (roughly speaking, dark energy behaves like antigravity, and pushes things apart, stopping them from falling together.)

    Of course, weak lensing is just one of the things this guy is meant to do -- there are lots of other neat things that hopefully someone more awake than I can describe.

    --
    Protect your liberties. Donate to the ACLU
  7. Re:Just Think... by Zog+The+Undeniable · · Score: 4, Informative
    Probably not. Digital zoom is useless because it just magnifies part of the picture without increasing resolution. It may be useful for video (especially if the CCD has a higher resolution than TV) but it's essentially a "marketing feature" for still photography.

    Anyway, with 500MP you're going to be severely limited by the resolving power of the lens. It's quite difficult to get even 100 line pairs per mm with the best 35mm photographic lenses (lenses for larger formats tend to be much worse because it's harder to maintain accuracy over a large glass area, plus it's not as necessary with lower enlargement factors). A 500MP sensor needs a pretty exceptional telescope in front of it.

    --
    When I am king, you will be first against the wall.
  8. Finally!!! by Eberlin · · Score: 5, Funny

    Finally something that has higher system requirements than Longhorn!!!

  9. I bet.. by platypibri · · Score: 5, Funny

    Even at this level of digital imaging, it has a weak, useless flash, intolerable low light noise, and sucks batteries in no time. Actually, I'm really looking forward to seeing the images this thing captures

    --
    Yeah, I guess I'm funny like that.
  10. DECam? by spare.dave · · Score: 2, Funny

    Time to dig up the old Digital icon?

  11. Re:Just Think... by fabs64 · · Score: 2, Informative

    ... if the camera is 500MP then yes the digital zoom would in fact be useful, being that the resolution is so massive you can keep zooming in and zooming in for a very long time before there's any noticable degradation in image quality (assuming a perfect lense etc here which is not possible). what i'm pretty sure he meant was, say take a photo from 200m above a busy city st, and u could sit there for hours and hours just zooming in on that photo looking at cracks in the sidewalk or the hairs on peoples heads.

  12. Nice piece of kit! by Paul+Townend · · Score: 5, Interesting

    The article mentions "The five-year DES hopes to generate about 100 terabytes of data" that will be released to the public at regular intervals....

    This kit is probably one example of why the world needs more 92 Tbs routers; sharing the data generated by this baby will probably be a task not unlike that faced by the Large Hadron Collider at CERN. You're going to have to have a really nice architecture and set of protocols to be able to efficiently pass around these images - possibly this is where Grid Technology comes in to play....

    Of course, then you'll need something to actually process the images on! I guess Intel and AMD still have a rosy future ahead of them...

  13. Nice, but... by Bill_Royle · · Score: 5, Funny

    Is there Linux support for it?

    1. Re:Nice, but... by bobhagopian · · Score: 3, Informative

      Though parent is (+5, Funny), the answer to his question is most likely yes. In all the time I've spent in various physics research labs, I've never seen anything *but* Linux. The story would be different if the CCD was being launched (in which case it would probably run on a specially written variant of VAX). But the drivers/utilities for land-based devices are written almost exclusively by the scientists themselves (not engineers), and most of them stick with Linux.

  14. Re:My Scanner.. by tasinet · · Score: 3, Funny

    Hmm.. Attach a pair of 5$ binoculars to your 106$ scanner and you have your personal deep-space telescope!
    Now attach that to a $1 paper airplane and you have DIY Hubble! yay!
    total cost: 106$
    Makes you wonder how NASA managed to spend
    so much on Hubble!

  15. Re:Just Think... by baritono · · Score: 2, Interesting

    Keep in mind, however, that this is going to be used with a reflector telescope. And that this telescope has a 4-meter aperture. The primary mirror in a telescope of this size costs millions of dollars, and is machined to an incredibly precise level of accuracy. The question is, when do we get parabolic reflector handheld digicams?

  16. Taking a rule of thumb too far... by supercytro · · Score: 4, Funny

    [Person A]I told you before, megapixels don't matter... [Person B]But it's 500 Megapixels... [Person A]500 megapixels, 5 megapixels... it doesn't matter. Everyone knows that. It's common knowledge that megapixels is just a marketing trick. [Person B]But... [Person A]Look I read slashdot and everyone says the same. [Person B]ok...

  17. Re:CCD? by CyberBill · · Score: 4, Informative

    CMOS is cheaper and can transfer the image faster off of the chip, but CCDs offer lower dark noise and lower reading noise, which means that your pictures are clearer and more scientifically usuable. CCDs are also INCREDIBLY more sensitive than CMOS, with the newer chips able to get upwards of 85% efficiency.

    -Bill

    --
    -Bill
  18. Meanwhile, in telescope control by Anonymous Coward · · Score: 3, Funny

    Scientist: Shouldn't the telescope be pointing into
    deep space rather than at that satellite with the
    big mirror on it?
    NRO guy: Nah, this is good.

  19. Re:Just Think... by troon · · Score: 2, Informative

    Not really. If you're looking for a decent A4 print, you need at least 5MP. A raw image from this beast contains 100 of those images, so you could use "digital zoom" (actually, just cropping) to concentrate on specific parts of the image at perfectly acceptable resolution.

    You're right about the general uselessness of digital zoom on low-end digicams, but this is a different beast.

    --
    Ydco co ,df C erb-y go. a Ekrpat t.fxrapev
  20. Search for Dark Energy by Chelloveck · · Score: 4, Funny

    How can they tell a picture of dark energy apart from a picture where they just forgot to take the lens cap off?

    --
    Chelloveck
    I give up on debugging. From now on, SIGSEGV is a feature.
  21. If you build it ... they will come.... by telstar · · Score: 3, Funny

    Didn't take long for somebody to come up with a use for that Cisco router...

  22. they should wait by lordmoose · · Score: 4, Funny

    I heard that the 502 mega-pixel camera is coming out in six months.

  23. high res images are not new by vijayiyer · · Score: 3, Informative

    There seems to be a lot of interest all of a sudden on slashdot on super high res images (yesterday there was an article on a large film camera which was by no means revolutionary or record setting). It's really not that cutting edge. If you go to www.betterlight.com, they're releasing a 4x5 back capable of 10200x13800 pixels soon, and already have one available that's about 100 Mpixel. Granted, these are slow, but they've been available for a long time and are used daily by product photographers. I shoot 4x5 myself on film and make 550 MB scans. It's relatively cheap and very high res.

  24. Astroid Hunter? by BurritoJ · · Score: 2, Interesting

    So, if this thing can see 15% of the sky at a shot, can it be used to look for incoming 'Global Killers?'

  25. Question is... by squidfrog · · Score: 2, Funny
  26. Dark matter in far away galaxies... by new+death+barbie · · Score: 2, Funny


    so... what kind of flash do I need?

    --

    It's supposed to be completely automatic, but actually you have to press this button.

    1. Re:Dark matter in far away galaxies... by mengel · · Score: 2, Funny
      Well...
      • Really Big
      • Way Back in Time
      Of course, that last one is the hard part :-)
      --
      - "History shows again and again how nature points out the folly of men" -- Blue Oyster Cult, 'Godzilla'
  27. cost of storage by pablo_max · · Score: 2, Interesting

    That actually would not cost to much more to store when compared to the cost of getting your film done at a 1 hour photo.
    Considering I payed 10 bucks for a 50 pack of cd's which is about normal. So * that by 700 meg and /by 1.7gig and you've got 20.5 pictures @ 49 cents a pic.Now to develope a single 25 picture roll of kodak APS film is 10.00 (9.99 actually). so thats 40 cents a print.
    Yes I know it would be hard to break the image between three disks but im just saying cost wise its not much at all.

    1. Re:cost of storage by Psymunn · · Score: 2, Funny

      Better Yet, Why don't you just register coolAstroPicture_210@gmail.com and store your picture there. Total cost per gig of storage, nothing. Thanks google!

      --
      The Neo-Bohemian Techno-Socialist
  28. RHIC isn't pure linux... by caveat · · Score: 2, Interesting

    i did some work at Brookhaven National Lab a while back; i hooked up with a cute chick who was into physics and got to slum around the Relativistic Heavy Ion Collider quite a bit (mostly the STAR detector, for those who care). i almost choked when i saw a win2k workstation humming away, but that was just the interface computer (there tend to be a lot of interns and such working, so a windows frontend is handy, cuts back the learning curve quite a bit). the rest of the lot was a hodgepodge of unix kit; the really really mission-critical hardware (the stuff that actually ran the collider) was running Solaris, at least as near as i could tell, along with quite a few linux and sgi boxes around for data processing and visualization (if you want pretty posters, get the gold ion collisions from the website).

    --

    Facts do not cease to exist because they are ignored. - Aldous Huxley
  29. Damn by hkb · · Score: 2, Funny

    I was expecting red shift .5 capabilities...

    --
    /* Moderating all non-anonymous trolls up since 2004 */
  30. pixel size < cell size by morcheeba · · Score: 4, Interesting

    If you're 6 feet tall and we use the long dimension of the image (240k pixels), that's 7.62 microns per pixel. A typical cell is 10 microns, so we've got a pretty detailed picture of you.

  31. Re:Just Think... by neurojab · · Score: 2, Informative

    >youu can keep zooming in and zooming in for a very long time before there's any noticable degradation

    I think a better way to put it would be that here is that if you want a smaller image( less information) you can selectively crop it out. If you're targeting 1-2 megapixels final size, you could be quite selective in finding the perfect picture in a 500 megapixel image.

    Digital "zoom" is badly named because it's not really a zoom, it's a crop, followed by a resample. In practice most people find that they want to take full resolution pictures all the time, and save the cropping for later, on their PC - where they can have tighter control. I imagine that the buyers of this device would have a huge storage device to attach to it, and still do the same thing.