Slashdot Mirror

← Back to Stories (view on slashdot.org)

'Digital Universe' To Add 1.8 Zettabyte In 2011

Posted by CmdrTaco on from the less-than-half-of-it-is-porn dept.

1sockchuck writes "More than 1.8 zettabytes of information will be created and stored in 2011, according to the fifth IDC Digital Universe study. A key challenge is managing this data deluge (typified by the Large Hadron Collider at CERN, which generates 1 petabyte of data per second)."

8 of 60 comments (clear)

  1. LHC data is _not_ stored in the digital universe by rbrausse · · Score: 3, Insightful

    the experiments may generate the PB per second but most of the data is rejected before it hits any storage system...

  2. Re:LHC data is _not_ stored in the digital univers by Infiniti2000 · · Score: 3, Insightful

    Indeed, only about 25PB are stored every year from the LHC.

  3. Can I have that in LoCs by Bob+the+Super+Hamste · · Score: 4, Funny

    Can we get that in a proper measurement like Libraries of Congress.

    --
    Time to offend someone
    1. Re:Can I have that in LoCs by Phurge · · Score: 2

      oops 1.8 ZB = 144 x estimated information content of all human knowledge.

      --
      I'll see your hokum and raise you a boondoggle.
  4. How much is redundant by Bob+the+Super+Hamste · · Score: 2

    I wonder how much of that data is redundant. I know that for one of my side projects I have "redundant" data that I got from the Minnesota DNR, various MN counties, the state legislature, and the federal gov. Even after it had been preprocessed and trimmed down so it only has what I care about it is still around 12GB of vector data which is about 1/3 the original size.

    --
    Time to offend someone
  5. Re:large size by L4t3r4lu5 · · Score: 2

    Don't worry, the large size won't be an issue. You can put it in a ZIP and then put that into another ZIP and so on.

    That's just stupid. They use the same compression algorithm!

    Put it in a ZIP in a TAR in a RAR in a 7z in an ACE in a bZip in a CAB in a dmg in a a ARJ, and finally save it as a GIF. You can't use JPEG as it's lossy.

    --
    Finally had enough. Come see us over at https://soylentnews.org/
  6. Large Hadron Collider data anomaly? by L4t3r4lu5 · · Score: 3, Interesting

    So it generates 1PB of data per second, yet from the article "[T]he data comes from the four machines on the LHC in which the collisions are monitored â" Alice, Atlas, CMS and LHCb â" which send back 320MB, 100MB, 220MB and 500MB"

    That's a few orders of magnitude short of 1 Petabyte, folks. Where are these numbers coming from?

    --
    Finally had enough. Come see us over at https://soylentnews.org/
    1. Re:Large Hadron Collider data anomaly? by MartinSchou · · Score: 2

      If you drive 60 miles/hour for 30 seconds, you haven't driven 60 miles. One is a measure of speed, the other is distance.

      Same with this. 1 PB/s is speed. 1,140 MB is the amount of data. All it really means is that these 1,140 MB are generated (and possibly collected) in 1.06 microseconds.