Slashdot Mirror
First 500 Terabytes Transmitted via LHCGlobal Grid
neutron_p writes "When the LHC Computer Grid starts operating in 2007, it will be the most data-intensive physics instrument on the planet. Today eight major computing centers successfully completed a challenge to sustain a continuous data flow of 600 megabytes per second on average for 10 days from CERN in Geneva, Switzerland to seven sites in Europe and the US. The total amount of data transmitted during this challenge -- 500 terabytes -- would take about 250 years to download using a typical 512 kilobit per second household broadband connection."
...this network be able to handle Longhorn SP1?
Can it handle a slashdotting?
Now we don't have to wait around for our porn!
The max rate for HDTV is 25Mbps/second. 25 megabits = 2.98023224 × 10-06 terabytes
So that makes this data rate equal to 46603 hours of maximum data rate HDTV. Hmm as soon as pr0n adopts it then it will be a success just like how the regular internet evolved.
//insert perfunctory comment about library of congress here
On a side note, I tried to find out what the real data size of the LOC is, but I could not.
If you blog it...
...a box full of DLT, LTO, or AIT tapes. With FedEx at my side, I can have several hundred terabytes sent almost anywhere on the planet in 24 hours.
Of course, the latency for this gargantuan data pipeline is a bit on the high side...
In the end they will lay their freedom at our feet and say to us, Make us your slaves, but feed us. - Fyodor Dostoyevsky
At least things can transfer alot faster within US, if we actually lit the dark fibre underground. We planted so many during the .com eras, yet so many are still unlit due to unwillingness to the hire more techies for maintainance.
Well going outside the US is a different story. I really don't know how we connect to Europe etc.
This is not the internet you are looking for.
Hey Blizzard. Knock knock. Take note. You have no excuse for WoW server problems now.
What i wanna know is when will it be available directly to my home.... Imagine all the p0rn you could download...
sig goes here!
Whoa! That's a lot of Large Hardon Collider porn...
I dont know about you .. but my Road Runner is 5mbit/sec .. not 512k. That's only 25 years!
But seriously. What do you transfer then? I mean, how many Libraries of Congress do you need sitting around on disk.
= Grow a brain...
I'm obviously not the only who thinks so. And here I thought I was being terribly clever. Man, I gotta get me some new material!
"Yeah, well, Dracula called and he's coming over tonight for you and I said okay."
How many Library of Congress' is that?
Hexy - a strategy game for iPhone/iPod Touch
And then they shut the thing down.
-Randy
Thats great and all but none of us will be on anything like that for years. If Time Warner had that here they would charge one child a month. You would need 12 wives just to cover your internet bill.
The perfect solution to connect my beowulf clusters!
I sympathize with you. I hold the opinion that references to porn will ALWAYS be funny, no matter how "+1 Redundant" they are.
The total amount of data transmitted during this challenge -- 500 terabytes -- would take about 250 years to download using a typical 512 kilobit per second household broadband connection."
I guess it's time to upgrade my connection again.
The net will not be what we demand, but what we make it. Build it well.
Ive been looking all over for it.
spelling is for people who doens't know better...
Interesting to note, the Internet2 just had a string of lawsuits pertaining to students using the service for illegal filesharing.
Will this allow you to fileshare so fast that no one can even track it?? Now that would be interesting!
Seriously though, after reading the article and the miscellaneous links. The numbers were astounding! In comparison to my own broadband, I can get 5 or 6 gigs downloaded in a VERY good day at most. Whereas this network enabled traffic of up to 50 terabytes a DAY! Woot woot! When can I hook up for it?
Only 10 days? I guess the RIAA sent cease and desist letters.
How many Library of congresses does this equal?
Is that 512kb typical household broadband speed upload or download? I guess for upload that makes sense since most broad band connections are not symmetrical. Download is a different story. I have about 3.5 on a dsl and that is fairly typical for the cable guys as well.
In Republican America phones tap you.
"640K ought to be enough for anybody." --Bill Gates, 1981
/., 2005
"640MB/sec ought to be enough for anybody." --Me,
Wer mit Ungeheuern kämpft, mag zusehn, dass er nicht dabei zum Ungeheuer wird. --Nietzsche
I'm glad I have GetRight.
Imagine where the porn industry could go in 2007
fuvoo: watch something
More to the point, the time it would take to get the data onto and off the tapes is left out of your argument. The bandwidth of a truck full of tapes is an old argument, but they're just so damn slow at both endpoints, they're not that useful after all
When the data arrives through a network pipe, it's on disk ready to be crunched through whatever program you're running...
8 or 9 years ago, I used to work in the post-production industry in Soho, London. There's a network called 'Sohonet' where lots of the major post-houses had ATM links to each other (hey, ATM was blazingly fast for the time
Simon
Physicists get Hadrons!
500 terabytes -- would take about 250 years to download using a typical 512 kilobit per second household broadband connection
Well, I've got a 3 megabit connection! It'd only take...uh...well, 42 years or so...but I'd upgrade to that 1 gigabit connection they have in Asia before it finished...
The difference between spam and poop is that you don't have to dig through septic tanks looking for real food. -- Me
I propose a new unit for measuring time: the household-broadband terabyte. I'm 50 household-broadband terabytes old, how about you? Sorry if I seem a little loopy; I only got 1 millihousehold-broadband terrabyte of sleep.
What was not revealed in the article, was that the majority of the data was composed of pictures of Goatse and TubGirl in ultra-high resolution..
At that rate it would still take a little over 3 years to give every family in the USA one copy of SimplyMEIPS from that single pipe.
Now, with a dozen pipes like that the task could be done in a month....
Running with Linux for over 20 years!
Are now drowning in their own spooge....
What is with these non-standard terms like "Terabytes" and "Megabytes"? Please re-state the bandwidth and the amount of data tranferred in LoCs (Libraries of Congress) and KLoCs (Kilo Libraries of Congress) so that the rest of the world can understand the magnitude of this achievement.
Imaging 2007, *AA has made it almost impossible to download any content. So I'm sitting on 600 MB/sec of BW and checking /. and reading emails.
fuvoo: watch something
It's good that they're speeding this thing up. One day, all homes will have this kind of broadband connection coming in. This will be a necessity because all television programming, telecommunications, and other functions will take place over this network. When you rent a movie, you won't have to wait for a DVD to come in the mail. It will instantly be there and ready for you to watch. When you download pr0n, you won't have to wait for it to get there, losing your current state of passion. This is going to be extremely important for the twenty-first century.
I was wondering why the need for so much data.. couldn't they possibly process the vast portions of experimental data "locally", within same network for greater bandwidth throughput. And simply send over processed, summarized chucnks of data?
Unless, of course, this is just a case of a scientific exercise to find out how much of 'any' data could be sent across.
Yep, the Internet surely has evolved. One day, we'll be able to piss people off with a shitty Debian-based distribution at a rate far faster than ever before!
...you probably can't get it without also having your Local and Long Distance bundled through them as well.
512Kb is only 64k/s. I get closer to 3200Kb (400k/s) on my road runner connection.
500 terabytes -- would take about 250 years to download using a typical 512 kilobit per second household broadband connection."
DSL is rock solid. Lies, all of them. I'll be the first to try moving my 500 terabytes of uhm, research videos, to this here other harddrive.
...the cult of Einstein still prevails so all the information will be discarded as inconvenient to their theories. When they get tired of being contradicted by experimental results, they'll download porn and after finally getting some, lose interest in pocket protectors and science freeing up the accellarators for serious usage by junior geeks including impressing girls with "look at the size of my collider" lines, heavy-duty nanowelding, investigating useful things like warp travel, and of course Ghostbusting.
Or not in which case we've got a nifty new thing in the toolbox for science on planet Earth.
Could go either way.
If my grammar and spelling are off, I am [distracted/tired/careless] (take your pick)
Its 50 libraries of congress.b ytes+to+%22libraries+of+congress%22
http://www.google.com/search?hl=en&lr=&q=500+tera
The total amount of data transmitted during this challenge -- 500 terabytes -- would take about 250 years to download using a typical 512 kilobit per second household broadband connection
Thats why I d/l at 6 Mbits/ second.
I mod down so you can mod up. Your welcome.
We all know that scientist have HDTV and the good pron!
OK... they lit up the equivalent of two OC48's worth of bandwidth. That's half of an OC192 or a 10G Ethernet. There have been long haul OC192's for a number of years now. If I hook up a hardware-based traffic generator and run at 100% over an OC192 for a few weeks will I get a slashdot article, too?
On a related note, CERN is now being sued by the MPAA & RIAA. A spokesmen was commented, saying, "Obviously with 500 terabytes of data being transmitted on the internet, at least some of it had to be copyrighted materials represented by the RIAA and the MPAA. As we know, the internet and communication grids serve no real purpose other then to pirate movies and music."
The lawsuit is expected to destroy CERN and any sort of decent networking research anybody was even thinking about doing for the next 50 year.
I'd like to take a partial credit for this if that's okay.
Wow, do you stop to go to the bathroom?
. . . or was it the datumplane?
any Simmons fans out there?
I want to know where I can find a pussy this big!! Can you imagine what it would feel like to fuck something like that?!! I love big pussy, and this would definitely qualify as big.
Time required by my home internet connection, 3mbps, to transfer this data: 41.6666666... years. Rounded to one sig fig, since 500TB is: 42 years. It really IS the answer to life, the universe, and everything.
I am scientifically inaccurate.
http://www.hongfire.com/forum/forumdisplay.php?f=6 5
I read somewhere that it was actually three copies of Bill Clinton's book.
nt
I am the maverick of Slashdot
With as much issue as is being made over blogging and cams today, imagine what they will be trying to govern behaviorally at 600 Meg? At ISDN speed there was "warez awareness". 1 Meg, The RIAA and DMCA jumps on us. Now people are having work and legal issues over cameras and blogs. Add Trusted Computing into the situation and pow! no more data safety at all. Of course at that speed everything can run at full length totally encrypted, but could you imagine the buss speed required to compute at that level?
Dark Fibre
The Metamucil of choice by all Lord Siths
The data rate might even be bigger than at Cern: 20 terrabit/sec straight after the A/D converters and still a mighty 0.4 terrabit/sec after the initial data reduction (DSPs + FPGAs). All the remaining data will be transfered over a dedicated fiber network to a central computer. To reduce all this data they need a big fat supercomputer, this will be a IBM Blue Gene with serial number 2, to be handed over tomorrow. For the moment it will be the fastest computer in Europe and ranking somewhere in the top 10 of the world.
karma police: arrest this man, he talks in maths; he buzzes like a fridge, he's like a detuned radio. [radiohead]
With all the vulnerabilities in Longhorn, yeah... secure OS my ass.... the theory that any new network advances in speed, will just be saturated at the rate of about 65-85% with Spam and Malicous attacks and hijacked PCs doing their thing. Oh yeah... porn downloads and torrenting.. do not forget that too.
:-P
So with all this new potential global network speed increases we may reap... those silly bastards out there will just gum it up with the useless 2 out of 3, spam, windows viruses and attacks... but porn, that is okay as we all have our needs.
" When it begins operations in 2007, it will produce roughly 15 Petabytes (15 million Gigabytes) of data annually, which thousands of scientists around the world will access and analyse..." I mean, uh oh.. that's something like 19 megabytes/second ? *collapses* Of course the data flow will not be continous, but.... wow.. huhuh :)
Since when is 512 a typical household connection? Maybe back in the days Clinton, when boy-bands roamed the earth...
A small canister with the CERN logo was found in the home of the RIAA/MPAA. According to security officials, "We cannot find this canister as it is hidden, and the culprit utilized one of our wireless cameras. The interesting thing about this transparant container with a count-down timer is that it has a floating ball of what looks like silver in the middle of it."
I mod down so you can mod up. Your welcome.
Seth Lord and RIAA Chief Mitch Bainwol, felt a sudden disturbance in the force. It was a like a thousand music producers and label execs suddenly cried out in grief and dispair.
sri
It would only take 247.73274987316083206494165398275 years. I wish these articles would check their facts. 247.73274987316083206494165398275 I could live with. I think at 250 I'd start to get impatient...
What kind of hardware are you writing to? I dont know of any home equipment that will sustain that speed. Can anyone give me some insight into what would be able to store the data as fast as it came in?
CS: It is all sink or swim...oh and did I mention there are sharks in that water?
who'd 'a thunk?
pigfukr
Should they transfer 1024 Terabytes and store it all in one chunk, they will have a PetaFile.
You have 600,000,000 hard drives in a striped RAID array. Then you only have to store 1 byte per second.
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
MPAA math: One movie per second x 60 x 60 x 24 x 365 x $20 x 3 people watching per movie = 1.89 billion dollars in lost revenue per year!
MPAA conclusion: All computers should come with a MPAA backdoor.
but can even move faster than light on a bicycle?
every day http://en.wikipedia.org/wiki/Special:Random
600 megabytes per second for 10 days -- that's one hell of an mp3 collection.
This ISP probably subsribes to RIAA's "code of conduct" for ISP's. This required them to notify RIAA notice of this "unusually high" use of bandwidth as "substantially indicative of copyright infringement." Consequently, RIAA got a collection agency to send a bill for $10,000,000,000.
dont know if it's interesting... but wonder what data was sent at 600 megabytes per second on average for 10 days.
I can think of one application that would eat up
that bandwidth pretty quickly - building a
transporter beam for a human. Now, using very
rough order of magnitude calculations, let's
figure out how long it would take to send the
amount of information required to specify the
location of each atom in my body with sufficient
precision to reassemble on the far side. I'm
made up of around 10**27 atoms and each one's
position would need to be specified to the
nearest 0.1 nanometers in X, Y and Z. Assuming
I can do this in 10 bytes per particle (not
really enough, but I'm prepared to be fuzzed
up a little bit by the transporter process)
then I'd need to ship 10**28 bytes in order to
reconstruct a human. At 6x10**8 bytes/second,
I'd have to wait for around 10**19 seconds
to get transported - if there are 3x10**7 seconds
in a year, we're still talking about more than
terayear to do the deed... I'd say we need
more bandwidth... Lots more bandwidth...
one must wonder what that 500TB consisted of that was transferred. was it the same file over and over again? was it just one gigantic file? was it randomly generated bits? or was it... bittorrent?
HD Trailers
PORN
eom
(can't believe I haven't seen one of those with a FUNNY yet)
--- We need more Ron Paul!
from /dev/zero to /dev/null?
I wonder how much of that 500TB wasn't pr0n.
Thanks to Speakeasy, it'll only take 20 years to download this at my house! Suckers!
Current milestone: 600MB/s for 10 days
Target: 1500MB/s for 10 years
Don't you think.
You don't have to be smart to use a Mac, you just have to be smart enough to buy one
Disk drives are a bit under $1/GB these days (you'll need a few extra controller cards etc for convenience, so round up.) So 500TB is about $500K, and you can build some kind of RAID-like thingy that lets you pop the racks out onto a Fedex truck without wasting the amount of time copying to tape would take.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
how many libraries of congress per hour is that?
People who think they know everything really piss off those of us that actually do.
India has only partially realized the Boom, because they only partially implemented telecom liberalization. For instance, there are hundreds of gigabits per second of fiber going BY India's cable heads, but only a few GB actually able to drop there, because the VSNL good-old-former-monopoly-boys still have their hooks into it. They've loosened up enough that there *is* a booming call center business, but it's not like you can actually get wavelengths delivered to Bangalore for prices that have any relationship to the cost of installing them.
China's somewhat the same way, though they're starting to get better. Their government is still hopelessly obsessed with censorship, so it's hard to install infrastructure that's too fast for them to wiretap, but they're gradually getting things done because the ex-commies are now making money.
Thailand is a tougher case. Their geography gets really rough and wrinkly once you're more than a few km outside of Bangkok or a few other big cities, and they've still got something that acts like an old corrupt PTT. It's getting better, but it'll be a while before you can really telecommute from Phuket, and the tsunami didn't help anything. Similarly, Costa Rica has amazing geography, being located where Central and South America squish into each other, but they only need a couple of fibers to get San Jose and Cartago on the net - but the telecom bureaucrats are kleptocracy that's trying to criminalize VOIP because it cuts into their profit margins rather than encouraging it because it creates jobs for people who aren't their buddies.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
...but when that ten years is gone, that's about as much as an average persons warez d/l rate...
well _above_ average persons...
what did moore's law say about this data transfer stuff, anyway?
Would they charge an arm and a leg, or a left nut.
I'd go for it if it was only a left nut, as It would cause me severe cramps in my one hand I have left jumping from keyboard to mouse to lube to crotch.
I'm just sayin'.
"Come on over here, baby, I want to do a thing with you." - A Cop, arresting a non-groovy person after the revolution, Firesign Theater
They are still people using 56k to connect to the internet. They are so happy that they got web accelator for free [SO FAST] Those people can't handlle this type of speed. Heck they don't know what a Tera means
It would take me approximately 2800.5405715432815703818413845514 years or 2801 rounded to download 500 terabytes on my crappy dialup connection (which is even shared with another computer). So quit complaining that you'd have to spend a measley 200 years or so to download it, since by the time the file is half done, science will have found a way to make people live longer so you could actually be alive when your download finished. No amount of scientific advances could make me live 2801 years.........
[Insert Witty Sig Here]
would take about 250 years to download using a typical 512 kilobit per second household broadband
How long would it take on a "typical 56k household dialup connection"?
True, but he lives in Utah.....