Slashdot Mirror
'Digital Universe' To Add 1.8 Zettabyte In 2011
1sockchuck writes "More than 1.8 zettabytes of information will be created and stored in 2011, according to the fifth IDC Digital Universe study. A key challenge is managing this data deluge (typified by the Large Hadron Collider at CERN, which generates 1 petabyte of data per second)."
the experiments may generate the PB per second but most of the data is rejected before it hits any storage system...
Wow that's a lot of data. Can't wait to see more of the results published.
Entropy just isn't what it used to be.
That's 1.8 x 10^-6 hellabytes for those of you keeping track.
"What the hell is an aluminum falcon?"
We're going to have two make *two* different ZFS filesystems to hold it all
Indeed, only about 25PB are stored every year from the LHC.
Welcome to the internet.
Shouldn't it be "Pebibytes"? We're supposed to be geeks.
No sig today...
Can we get that in a proper measurement like Libraries of Congress.
Time to offend someone
Shouldn't it be "Pebibytes"? We're supposed to be geeks.
Yes, but we're not morons.
Knowledge is power. Knowledge shared is power lost.
I wonder how much of that data is redundant. I know that for one of my side projects I have "redundant" data that I got from the Minnesota DNR, various MN counties, the state legislature, and the federal gov. Even after it had been preprocessed and trimmed down so it only has what I care about it is still around 12GB of vector data which is about 1/3 the original size.
Time to offend someone
that's just Netflix.
to store this amount of data, you need 57.5 billion 32GB iPads which will cost around $34.4 trillion — and that's equivalent to Gross Domestic Product (GDP) of United States, Japan, China, Germany, France, the United Kingdom and Italy combined. :D
Don't worry, the large size won't be an issue. You can put it in a ZIP and then put that into another ZIP and so on. Pretty soon it gets down to USB stick size and if you keep going you can reduce it to 1 byte if needed.
This might be the amount of data being created this year, but there will be many times this amount of data actually being stored. Remember, every repressive government in the world (USA, Britain, China, etc.) will be storing their own copies (or mandating it be done for them by ISPs).
rel=nofollow dude. Your linkwhoring is pointless here.
Finally had enough. Come see us over at https://soylentnews.org/
More space to be filled by Russian mining bots. Oh wait which universe is this?
Seven puppies were harmed during the making of this post.
And as geeks we understand that the English language isn't governed by a committee of Swiss engineers.
So it generates 1PB of data per second, yet from the article "[T]he data comes from the four machines on the LHC in which the collisions are monitored â" Alice, Atlas, CMS and LHCb â" which send back 320MB, 100MB, 220MB and 500MB"
That's a few orders of magnitude short of 1 Petabyte, folks. Where are these numbers coming from?
Finally had enough. Come see us over at https://soylentnews.org/
Indeed, only about 25PB are stored every year from the LHC.
No. They store all of it, but mostly in /dev/null
Those who can make you believe absurdities can make you commit atrocities. - Voltaire
(typified by the Large Hadron Collider at CERN, which generates 1 petabyte of data per second)
So, the LHC produces 1 petabyte per second, and given that there are 30+ million seconds in the year, that means the LHC produces 30+ zettabytes a year. Clearly there is a problem with your typification.
Geeks didn't change the standards to the new format. Sales people trying to make right the shit they've fed us for years did, most notably from storage vendors.
Because iPads are the most efficient way of storing large amounts of data.
I call bogus on this.
10e21 / 10e10 = 10e11 bytes/living human being.
The global GDP and global hard drive manufacturers simply cannot support a 100 GB hard drive per person per year... Cheapest option per byte is probably 1 TB drive for every 10 people. My basement therefore balances against a small African village, but there's plenty of small African villages, and only one me.
Even if all the ACTIVE /.-er types have a basement like mine, and they do not, there are simply not enough of us. And on a global GDP basis a tenth of a TB hard drive is way too expensive per person, that would put data storage at roughly "rice consumption" levels. And the rich are only getting richer while the poor get poorer for some decades now, so don't try the "world is getting richer thus can afford it" argument.
"Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
...so now I'm going to have to get *another* zettabyte hard drive :(
And as geeks we understand that the English language isn't governed by a committee of Swiss engineers.
Unfortunately, they're English engineers...
Those who can make you believe absurdities can make you commit atrocities. - Voltaire
You are right, of course.
That'll be 1,500,000,000,000 double density 8 inch floppies worth of data. Much more efficient, and at the last price I paid for them, (about 12 years ago now) they were $12.00 each (not per box, each)) so that is $18,000,000,000,000, or roughly 52.325581395348837209302325581395% of the cost of the iPads.
-nB
whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
And most of it will be junk data.
Data != Information. And then there's Metcalfe's law applied to information value.
That's a lot of porn...
Yes, and as geeks we understand that the quoted number is an approximate
one and the data generated are not inherenly binary, so there is no need
for either the precision of "exactly one PiB" or the context of "this is binary".
In fact, the decimal prefix is the much more sensible one to use here.
I suppose we should be grateful that data isn't measured in petahogsheads.
and why in hell does a /. tab not close immediately but does some shit for a few miiliseconds before closing?
Wealth is the gift that keeps on giving.