Slashdot Mirror

← Back to Stories (view on slashdot.org)

CERN Launches Huge LHC Computing Grid

Posted by Soulskill on from the just-waiting-on-the-actual-LHC-now dept.

RaaVi writes "Yesterday CERN launched the largest computing grid in the world, which is destined to analyze the data coming from the world's biggest particle accelerator, the Large Hadron Collider. The computing grid consists of more than 140 computer centers from around the world working together to handle the expected 10-15 petabytes of data the LHC will generate each year." The Worldwide LHC Computing Grid will initially handle data for up to 7,000 scientists around the world. Though the LHC itself is down for some lengthy repairs, an event called GridFest was held yesterday to commemorate the occasion. The LCG will run alongside the LHC@Home volunteer project.

32 of 46 comments (clear)

  1. Re:Why so much? by gardyloo · · Score: 4, Insightful

    You only see the impact images where something pretty or exciting happened. For each of those, there are several thousands to several billions of ones where nothing happened. Additionally, there are a lot of quantities to be measured which don't show up on pictures of particles doing curlicues in magnetic fields, such as spectroscopy data (at least several megabytes from each of several hundreds of detectors per collision).

  2. Finally... by Anonymous Coward · · Score: 5, Funny

    We can run Vista *with* Aero

  3. Doomed by dexmachina · · Score: 5, Funny

    I've heard this so called "grid" might create an information black hole from all of the data. Is this true? We're all gonna die!

    1. Re:Doomed by nawcom · · Score: 1

      It's actually going to open up a portal to Hell; Pat Robertson said so.

  4. DOS, anyone? by xdor · · Score: 3, Interesting

    So does this network "grid" rely on TCP? Can all this be rendered useless by Robert E. Lee's hack?

    1. Re:DOS, anyone? by Zibri · · Score: 1

      Yes TCP/IPv4. I saw an interview with some scientist working on ATLAS talking about the grid. Funny thing is, the interviewer was amazed "Is it REAL internet? It is not IPv6?"

    2. Re:DOS, anyone? by mysidia · · Score: 1

      So does this network "grid" rely on TCP? Can all this be rendered useless by Robert E. Lee's hack?

      Yes, but it's not open to the world, it is only accessible at all to their computing centers and research partners.

      Your attack would probably be noticed relatively quickly, due to the distributed nature of the grid and the fact they were concerned about security measures, and supposedly designed countermeasures into the system, an attack is likely to be rapidly quashed.

  5. Re:Why so much? by imsabbel · · Score: 4, Informative

    To you mean those particle trails with "impact image"?
    Just think about the resolution of those trails.
    Add the 3rd dimension.
    And then consider that to build this trail, they need the data of ALL sonsors in the volume, to pick out what belongs to the trail.

    And then think about his happening 10 million times per second...

    They filter out all but a couple 1000 of them, but this still amounts to a lot of data.

    And the higgs boson just doesnt appeast in one single image. It might show up in certain types of cascades, or anomalities in other processes, that only become obvious if a huge statiscal base is evaluated.

    --
    HI O WISE PRINCE. WHT TOOK U SO DAM LONG?
  6. Porn? by Anonymous Coward · · Score: 5, Funny

    "As the grid is ready but no data is expected to be produced by the LHC for the next few months, engineers have received permission to temporarily fill all 15 petabytes with adult material in an effort to test the infrastructure."

    1. Re:Porn? by kurzweilfreak · · Score: 4, Funny

      Mmm, hot particle-on-particle action.

      --

      kurzweil_freak

      5th Kyu Genbukan Ninpo/KJJR student

      Be the darkness that allows the light to shine.

    2. Re:Porn? by mysidia · · Score: 1

      "As the grid is ready but no data is expected to be produced by the LHC for the next few months, engineers have received permission to temporarily fill all 15 petabytes with adult material in an effort to test the infrastructure."

      I have a better idea... let's concentrate the power on cracking RSA.

      Specifically MS' certificates' private keys to be able to sign software to run on the Xbox, and to sign software like the LILO & Grub bootloaders to run in TCPA / Palladium "trusted" mode.

      They would be doing the public a great service by cracking and publishing the private keys that with those CA certificates.

      So I can use BitLocker on dual boot Vista / Linux systems.

    3. Re:Porn? by RDW · · Score: 1

      '"As the grid is ready but no data is expected to be produced by the LHC for the next few months, engineers have received permission to temporarily fill all 15 petabytes with adult material in an effort to test the infrastructure."'

      The problem, of course, is what to do with all this 'material' when the collider eventually starts producing data. It's now well known that Tim Berners-Lee hurriedly developed the Web within months of the LEP going on line in 1989, which was causing an equally serious storage problem by the standards of the time. In a desperate attempt to free up space on the servers, he succeeded in creating a distributed global system capable of storing CERN's vast collection of Ginger Lynn GIFs, Adult VHS screen captures, and dubious ASCII art.

    4. Re:Porn? by Anonymous Coward · · Score: 2, Funny

      You jest, but BTDT. A couple of years ago, when Audiogalaxy was the newest and greatest way to get music (you remember Audiogalaxy, right?), my university's computing centre and CS department got a Very Big Storage Box from IBM. I worked as an assistant there at the time. My boss told me he was "testing the box by downloading Audiogalaxy". I at first didn't get it, until he added, smirking: "...all of it." High load stress testing then was done by leaking knowledge of this box' existence to a couple of very big on-campus dormitories. Ahhh, those were the days...

    5. Re:Porn? by Hurricane78 · · Score: 1

      I have a much quicker solution: Delete Vista and disable TCPA. Finito! :)

      --
      Any sufficiently advanced intelligence is indistinguishable from stupidity.
  7. Whee! by jovius · · Score: 1

    From a circle to a grid, what will they come up with next?

    1. Re:Whee! by mikael · · Score: 1

      A cloud?

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
  8. End of the world? Again? by Anonymous Coward · · Score: 2, Funny

    Great, just Great. Whose idea was it to connect a wormhole machine to sky net?

    1. Re:End of the world? Again? by Clarky456 · · Score: 1

      It was probably Gordon Freeman's idea.

  9. @Home by jawee · · Score: 1

    Now you can help suck up the world from the comfort of your own home.

  10. Fantastic! by failedlogic · · Score: 1

    This is Fantastic News! If only the LHC could provide information to actually process data it would be an interesting project. ;) If I find any of the mystery particles on my computer, do I get a free black hole? Cash prizes, as some other distributed computing projects offer, would suck in comparison. Don't like someone? Cash won't always help but a black hole will ruin anyone's day!

    1. Re:Fantastic! by mysidia · · Score: 1

      In their spare time, they can try analyzing data from other collides.. perhaps some outsourced computing services.

      Perhaps they can make a sales pitch to some grid time to Google and buyers of mainframe processing.

      You know.. until the LHC comes online, use the resources to spider and analyze the web. Who knows... Higgs boson may be hiding on the interweb(TM) somewhere.

  11. Portal to Hell by CustomDesigned · · Score: 1

    Not just Pat Robertson, J.D. Frazer also:
    http://ars.userfriendly.org/cartoons/?id=20081004

  12. I has a by markov_chain · · Score: 5, Funny

    hadron!

    --
    Tsunami -- You can't bring a good wave down!
  13. Re:15 Gigs of data (source: the inq) by SnowZero · · Score: 1

    Did you miss the "million" in there?

  14. Re:15 Gigs of data (source: the inq) by timboe · · Score: 2, Informative

    I don't know why they need such a big grid, according to the inquirer they only create about 15 Gigs of data each year.

    No, 15 million gigs - now you see! And yes, a full detector read out consists of every non zero channel in the entire detector which comes to about 3 Mb per event and we readout ~200 events/sec. And there are 4 main detectors each doing this. Not even mentioning the processor power to run statistical analysis on these data sets!

  15. Re:Why so much? by lysergic.acid · · Score: 4, Informative

    consider that:

    • the LHC contains 150 million sensors collecting 700 MB per second.
    • the experiment accelerates beams composed of multiple "bunches" of 1.1 x 10^11 protons each.
    • each of the aforementioned beams contains 2808 "bunches."
    • when the beams converge they cause 600 million collisions per second.
    • each collision between two protons produces many smaller subatomic particles.

    scientists are tracking the paths in which the resultant subatomic particles travel not just to find detectable post-collision phenomena, but they are also looking to see what is missing from those impact images (what their sensors cannot pick up). this will allow scientists to predict strange and interesting new particles that science has yet to discover. but in order to detect what is missing, they have to make sure to record all that is there (or not missing). and that means tracking perhaps tens of billions of particles and their travel path in 3-dimensions at very high resolutions, and at very high sampling rates.

  16. Re:obligatory by RiotingPacifist · · Score: 1

    doubt it has a graphics rating above 1.5 so only without aero

    --
    IranAir Flight 655 never forget!
  17. Re:15 Gigs of data (source: the inq) by mysidia · · Score: 1

    It's much more massive than that.

    Also, they may not release all data.. I.E. They have a need to analyze much more data than will be published as "interesting" with regards to the experiment being run.

    You don't magically know what parts of the collected data are the most interesting until the analysis is completed on the grid.

  18. Re:15 Gigs of data (source: the inq) by owlstead · · Score: 1

    Hmm, guess I did. Darn that. I'll drink more coffee.

  19. Slac's Crystal Ball Detector - Oracle 10G by c0d3r · · Score: 1

    SLAC used to use the crystal ball detector for detecting the data and pouring it into an Oracle 10g grid of sun machines, and they'd data mine the data to generate theories. http://en.wikipedia.org/wiki/Crystal_Ball_(detector) I wonder what they call their detector for the LHC, and what database software they use. Also, I'd be curious to know what they use to mine the data, and how they go about it.

    1. Re:Slac's Crystal Ball Detector - Oracle 10G by Gromius · · Score: 3, Informative

      Traditionally particle physics doesnt use the data to "generate" theories as such. We use the data to measure various properties (W mass, Z->ll mass spectrum, lepton pt spectra), looking for descrepances with the theory predictions. Then we (hopefully) go, oops this doesnt agree with the theory, we'ld better come up with another explaination. Recently its been, ah SM predictions confirmed *again*.

      I can only really speak for CMS (one of the two big general purpose experiments) but every experiment does similar things. Basically the data is split into smaller datasets based on what we decided was interesting in the event (basically what trigger fired). So we split it into events with electrons, muons, photons, jets (yes events will have multiple of the above but dont worry about how we deal with it). Then each physicist looking for a specific signature (ie a top quark, or in my case high mass e+e- pair) runs their custom homebrew statistical analysis (which use common tools) to pick out the events they are interested in. There are also physicists who run custom designed programs to pick out *any* descrepancy from theory predictions but as they are more general, they arent as senstive as a dedicated analysis on a single channel.

    2. Re:Slac's Crystal Ball Detector - Oracle 10G by c0d3r · · Score: 1

      Don't you think a different approach should be made, where you use the data to create the theories, rather than for verification? Machine learning, neural networks and data mining are some of the biggest projects in corporate america these days, where you use the businesses resulting data to optimize and refine their operation.