Slashdot Mirror

Sorry. 100 Terabytes: The entire internet NOT!
100 Terabytes does not even cover 1 Patette of TB drives @ costco. ( I counted... there were 120 on the palette and 9 had been taken...111 terabytes of data on the wall.. i digress ).

The internet includes the largest databases in the world, and all the video as well as the raw data. and:
"The Internet Archive at BA includes the web collection of 1996 to 2006. It represents 1.5 petabytes of data stored on 880 computers."

So, you are off by more than an order of magnitude at least, if not more.

DUH! probed 2,800M addresses active, by the internet census.

http://wintercorp.com/VLDB/2003_TopTen_Survey/TopTenProgram.html

"Respondents projected that by the end of 2004, both transaction processing and decision support systems will more than double in size. These figures put us on track to break the 100-TB barrier sometime next year."

The largest databases on the internet broke the 100-TB barrier in 2005.

...they would have included a link to the WinterCorp report.

why not sell the data ?

because Claria (did)have one of the biggest databases of user information on the planet
http://www.wintercorp.com/vldb/2003_TopTen_Survey/ TopTenWinners.asp

12TB (in 2003) of data isnt something they are wanting to sell

Here you go. http://www.wintercorp.com/VLDB/2005_TopTen_Survey/ 2005TopTenWinners.pdf If you ever find mysql anywhere in that survey, even as a typo, that will be a day of celebration for the halfwits who make it.

"Real" databases...

http://www.wintercorp.com/VLDB/2005_TopTen_Survey/ TopTenWinners_2005.asp

The largest databases in the world are ranked here. No MySQL anywhere on the list... Sorry. Oh you mean it is good for selecting web pages from a database! Wow.

OMFG, stored procedures in Perl? What were they thinking...

Depends how you measure it but 70% is about right.

When you consider that your bank statement, electricty bill, tax bill and airline ticket almost certainly came from an IBM mainframe you get an idea of how pervasive these systems are.

Also if you look at a survey of the largest databases IBM mainframes do float to the top
http://www.wintercorp.com/vldb/2003_TopTen_Survey/ TopTenWinners.asp>

Having so few transactions for a database of this size probably helps them run without needing large expensive machines. Many VLDBs support thousands of transactions per second. I found a list here of top ten winners of a very large database scalability contest. The winner for peak performance was something like 20,000+ TPS.

Here's another link. These are the guys who run the survey. The latest report is not available online that I can find.

Winter Corp