Slashdot Mirror


World's Largest Working Computing Grid

fenimor writes "UK particle physicists claim that they will demonstrate the world's largest, working computing Grid with over 6,000 computers at 78 sites internationally. The Large Hadron Collider Computing Grid is built to deal with 15 Petabytes of data each year from the Large Hadron Collider (LHC), currently under construction at CERN in Geneva. 'This is a great achievement for particle physics and for e-Science,' says Professor Tony Doyle, leader of GridPP. 'Our next aim is to scale up the computing power available by a factor of ten'."

110 comments

  1. imagine by denthijs · · Score: 2, Funny

    the optimization flags on one of those,....

    1. Re:imagine by Anonymous Coward · · Score: 0

      I can guarentee they are not using Gentoo, it would take years to get the damn things ready, long enough so that a grid of computers would no longer be neccesary.

    2. Re:imagine by Anonymous Coward · · Score: 0

      It's compiled with -Omake_program_go_fast_now

    3. Re:imagine by caluml · · Score: 1

      Yeah, cos you couldn't make just one, and then netboot with NFS and DHCP, for example? Or image hard drives?

    4. Re:imagine by Anonymous Coward · · Score: 0

      Nope, because would'nt that completely defeat the purpose of using Gentoo?

    5. Re:imagine by Anonymous Coward · · Score: 3, Informative

      [80s]So funny I forgot to laugh[/80s]

      People are mostly using "Scientific Linux", an in-CERN-house Redhat fork, but some sites are experimenting with other stuff - one of the computer science aspects of the grid is researching how to make good use of heterogenous systems, though different linux distros aren't amazingly heterogenous in the grand scheme of things, there are challenges.

      And yes, there are people working on Gentoo, believe it or not.

      And Debian and fedora core 2 and 3 and mandrake clic and suse.

      And IRIX, AIX, Solaris and Mac OS X from the Real Unix camp.

      And there's some poor fuckers somewhere working on windows too.

    6. Re:imagine by Anonymous Coward · · Score: 0

      Idiot. No it doesn't. Gentoo allows optimisation for your particular hardware - but if your particular hardware is "256 identical Opteron boxes as cluster nodes", then compiling up gentoo once and using it for an install makes lots of sense.

      Though personally, I just use Debian and "apt-get source" on the packages where optimisation makes a major difference.

    7. Re:imagine by Ab0rtRetryFail · · Score: 1

      Imagine a beowulf cluster of.... Oh.... nevermind. :-(

    8. Re:imagine by wish · · Score: 1

      You have some evidence for that most people using Scientific Linux claim? The latest releases from
      CERN are still Redhat 7.3 not Scientific Linux(RHEL) based.

      I would be very supprised if anyone were running
      a non x86 linux setup since AFAICT most of the submitted jobs are native code not some portable
      bytecode.

    9. Re:imagine by Anonymous Coward · · Score: 0

      The group I'm in uses RH 7.2 or SunOS58 for building and typically RH 7.3, RHEL3, or SunOS59 to run analysis jobs. However, the plan is to switch the linux side to RHEL3/SLC3 real soon. RH 7.2 is pretty old now. I don't know the status of other groups that use gridpp resources.

  2. At last by modest+apricot · · Score: 5, Funny

    Finally, something to run doom3 on. Though I may still have to turn shadows off...

    1. Re:At last by LighthouseJ · · Score: 0, Offtopic

      man, I wish I had some mod points left, you'd get a Funny from me.

    2. Re:At last by camcorder · · Score: 0, Troll

      That project must have been funded by m$ to make at least one system that will be able to run Longhorn. No need to mention you'll be able to run kernel 4.0 or whatever on your p100 box anyways.

  3. Yeah, physics! by -ing+AnonymousCoward · · Score: 3, Funny

    But let's talk about something serious: how many FPS in Doom III?



    ...



    Mmmmm... That might be worth the upgrade then...

    1. Re:Yeah, physics! by Anonymous Coward · · Score: 0

      what about www.google.com
      computing grid?

    2. Re:Yeah, physics! by HermanAB · · Score: 1

      You can have at least 6000 frames concurrently...

      --
      Oh well, what the hell...
  4. able to handle 15 petabytes a year? by djfray · · Score: 5, Funny

    finally something to deal with those pesky environmentalists.... :-P

    --
    This sig is o Unfunny o Funny
    1. Re:able to handle 15 petabytes a year? by AresTheImpaler · · Score: 0
      finally something to deal with those pesky environmentalists

      what do you mean with "pesky environmentalists"? Doesn't peta means: People for the Eating of Tasty Animals? Bad joke, I know :D

    2. Re:able to handle 15 petabytes a year? by Anonymous Coward · · Score: 0

      semantics semantics......

  5. Global Domination. by Anonymous Coward · · Score: 0

    "'Our next aim is to scale up the computing power available by a factor of ten'.
    "

    And soon after it will become sentient and take over the world. Welcome our new lord and master.

    1. Re:Global Domination. by vandoravp · · Score: 1

      As long as it doesn't get a programmed taste for power and call itself Omnius we should be fine. It wouldn't hurt to keep all people who call themselves Barbarossa away from the grid.

  6. Computing power by nemexi · · Score: 2, Interesting

    Does anybody know facts about the computing power of the grid? How many teraflops will it be able to achieve?

    1. Re:Computing power by kristofme · · Score: 4, Informative

      In Grid computing, which is not exactly the same as high-performance computing, the number of flops doesn't really matter that much, it's more about providing an environment for multiple users to address problems that can be solved by splitting it up in a huge number of smaller tasks.

    2. Re:Computing power by Anonymous Coward · · Score: 0

      Well, I assure you, we still care about the FLOPS too. The LCG Grid is a grid of fuckoff huge supercomputers and linux clusters, and it's about providing an providing an environment for multiple users to address problems that can be solved by splitting it up in a huge number of freakin huge tasks, too.

    3. Re:Computing power by cmacb · · Score: 3, Funny

      What I'd like to know is: who has the largest non-working computer grid. My guess is that it would be a lot bigger.

    4. Re:Computing power by Anonymous Coward · · Score: 0

      If the program that's running on the grid can be partitioned so that there's no communication among the host machines, you can simply sum up the flops of each host. In that case, 6000 hosts at about 4 gigaflops per host would yield at total of 24 teraflops.

      Of course, many grid programs will require interprocess communication, and because comm on the grid often travels great distances and passes through many hops, comm latencies and bandwidth will be much worse than on traditional clusters/ supercomputers that have local interprocessor networks (like switched GigE or Myrinet). So flop performance ner node will almost always be much lower for grid apps than on most HPC clusters.

      Randy

    5. Re:Computing power by Anonymous Coward · · Score: 0

      There isn't a single Grid. Currently there are many collections of machines in various forms of Grid (and some machines may be in several different Grids at the same time).

      Basically the idea behind Grid is to enable a group of people (a Virtual Organisation) to use facilities (compute, data, etc) provided by one or more providers of these resources. Ideally the resources should be available on demands (like the Electricity Grid) and as simply and easily as possible.

      The Holy Grail is for the provision of the resources and the virtual organisations to be dynamic and secure such that any combination of providers and consumers can be created as need and opportunity arise. This is intended to allow consumers of resources to access as many resources as they can (or can afford) as required, and alternatively for providers of resources to have their resource be maximally used to maximise their investment.

      Some of the resources may be fixed, such as specific data sources or a particular proprietary application being run on a specific server, and some may be flexible, e.g. a machine capable of running a computing job if you ship the source of executable to it.

      To make sense of what is happening in the Grid you need to draw a diagram with the right layers on. Basically the Grid is a way to access services, and the machines themselves are a way to provide those services, but a single machine may have different services visible on different Grids but using the same base processors and disk etc.

      There are many challenges yet, notably ease of use (which is increasingly being addressed, see the GRENADE project), scalability of authentication and handling of virtual organisations, and financial and legal issues (quality of service, charging models, etc) which are also being looked at.

      Aaron Turner, White Rose Grid, Yorkshire, UK

  7. Grid vs. LHC@Home? by Anonymous Coward · · Score: 3, Interesting

    What's the point of the Grid thingy if they've also setup this?

    http://lhcathome.cern.ch/

    1. Re:Grid vs. LHC@Home? by vandoravp · · Score: 1

      My guess is reliabilty and specialization. Or, they're just greedy for power.

    2. Re:Grid vs. LHC@Home? by David+McBride · · Score: 4, Informative

      The LCG resources have several different things that most home machines do not:

      1) A Linux install with the requisite libraries for the already-written experiment analysis programs to run on.
      2) Fast network interconnects, both to other LCG cluster nodes at the same site (using Myrinet, Infiniband, etc.) and large network connections to other participating sites (ie 100Mbit+).
      3) Large amounts of reliable local storage, ie 1TB+.

      SETI@Home-like distributed computing problems only work well for problems which do not require large amounts of communication between nodes before, during, and after an individual run. Many problems do not fall into this category.

    3. Re:Grid vs. LHC@Home? by Anonymous Coward · · Score: 0

      LHC at home is not attempting to analyse actual data. The class of projects suitable for this kind of distributed computing (not much input or output data, lots of calculations) is relatively small.

    4. Re:Grid vs. LHC@Home? by Anonymous Coward · · Score: 0

      After reading this post, I think it is worthwhile to review the Ten Slashdot Commandments:

      1. Thou shalt reference Star Trek, the Simpsons, Family Guy whenever possible.
      2. Thou shalt immediately mod down any post containing the letters GNAA.
      3. Thou shalt not speak ill of open source, Linux, Linus Torvalds.
      4. Thou shalt attribute ridiculous quotes to Bill Gates whenever it helps get across a point.
      5. Thou shalt karma whore by posting a copy of the original article for all to see.
      6. Thou shalt not envy thy neighbor's Wi-Fi.
      7. Thou shalt decry the existence of patents.
      8. Thou shalt rise up in fury against the demons at the RIAA and MPAA.
      9. Thou shalt demean CowboyNeal whenever possible.
      and finally...
      10. Thou shalt never, ever, under ANY circumstances, post a link without the corresponding href command. EVER, you lazy bastard.

    5. Re:Grid vs. LHC@Home? by Anonymous Coward · · Score: 0

      Actually, you don't even need to do the href anymore - just do a - Like this http://www.redmeat.com/

    6. Re:Grid vs. LHC@Home? by Fallen+Andy · · Score: 2, Informative

      lhc at home is not for processing the data output, but helping them to position the magnets as they
      *build* the LHC.

    7. Re:Grid vs. LHC@Home? by shobadobs · · Score: 1

      2. Thou shalt immediately mod down any post containing the letters TANN. (TANN ROT-13'd to avoid hypocrisy)

      By your logic, your post should be modded down!

  8. /.ing after only a few posts, so before gone: by Jrod5000+at+RPI · · Score: 1, Informative

    This week, UK particle physicists will demonstrate the world's largest, working computing Grid. With over 6,000 computers at 78 sites internationally, the Large Hadron Collider Computing Grid (LCG) is the first permanent, worldwide Grid for doing real science. The UK is a major part of LCG, providing more than 1,000 computers in 12 sites. At the 2004 UK e-Science All Hands Meeting in Nottingham, particle physicists representing a collaboration of 20 UK institutions will explain to biologists, chemists and computer scientists how they reached this milestone.

    Particle physics experiments at the Large Hadron Collider (LHC), currently under construction at CERN in Geneva will produce around 15 Petabytes of data each year - 15 million, billion bytes. To deal with this vast volume of data, particle physicists worldwide have been building a computing Grid. By 2007, this Grid will have the equivalent of 100,000 of today's fastest computers working together to produce a 'virtual supercomputer', which can be expanded and developed as needed. When the LHC experiments start in 2007, they are expected to reveal new physics processes that were crucial in building the Universe we see today, and shed light on mysteries such as the origin of mass.

    Grid computing has been a target for IT developers and scientists for more than five years. It allows scientists to access computer power and data from around the world seamlessly, without needing to know where the computers are. Analysis for particle physics can also be done on conventional supercomputers, but these are expensive and in high demand. Grid computing, in contrast, is constructed from thousands of cheap units that can be increased to meet users' needs. Like the web before it, the Grid has the potential to impact on everyone's computing.

    GridPP, the UK's particle physics Grid project, was set up by the Particle Physics and Astronomy Research Council in 2000. On 1 September this year the project reaches its halfway point, with the official end of its first phase and the start of GridPP2. According to Dr Dave Britton, the GridPP project manager, "The first half of the project aimed to create a prototype Grid - which we've done very successfully. Having proved that a Grid can work, we're now focussed on developing a large-scale stable, easy-to-use Grid integrated with other international projects. This will let scientists tackle problems that are much larger than those possible today."

    Dr Jeremy Coles of Rutherford Appleton Laboratory is the GridPP production manager, responsible for making sure the Grid works on a day-to-day basis. He is giving the main GridPP talk in Nottingham, and stresses, "There are a lot of challenges in front of us as we expand our production Grid. In addition to the technical problems involved in providing a well-monitored, stable Grid, we need to address wider issues, in particular encouraging an open sharing of resources between groups of users."

    In Nottingham, conference delegates will be able to see how the particle physics Grid works. GridPP has developed a map that shows computing jobs moving around LCG in real time, as they are distributed to the most suitable sites on the Grid, run their programmes and then return their results home. The map can be seen here. Dr Dave Colling, from Imperial College, London, whose team built the map, said, "It can be difficult for people who have never seen a Grid working to imagine what it does. Our map is an easy way to see how a Grid can let scientists use resources all over the world, from their desktop. It's also useful for experts, who can easily see how well the Grid's working."

    Professor Tony Doyle, leader of GridPP, explained, "This is a great achievement for particle physics and for e-Science. We now have a true international working Grid, running more than 5,000 computing jobs at a time. Our next aim is to scale up the computing power available by a factor of ten, so that we'll have 10,000 computers in the UK alone, ready for the Large Hadron Collider in 2007"

    1. Re:/.ing after only a few posts, so before gone: by Anonymous Coward · · Score: 0

      Actually, it's not slashdotted at all, nor does it appear to be heading that way.

      And buddy, next time post AC, or be assigned the label of karma whore.

    2. Re:/.ing after only a few posts, so before gone: by Anonymous Coward · · Score: 0
      The response you will get is:
      "Oh, why Sir whatever do you mean (blink, blink, flutter, flutter) I thought fo certain that little ole website was about to go down, and I was jest doin' ma duty as a Southern Gentlewoman to post up a copy of the purty lil article..."
      Outright trolling and karma whoring is much less obnoxious.
  9. Analogy for the ADDers by rokzy · · Score: 2, Funny

    imagine a beowulf cluster of Half-Life 2 preloads! ;-)

  10. http://slashdot.org/www.cern.ch ? by caluml · · Score: 1

    Fenimor can't make hyperlinks.... :)

    1. Re:http://slashdot.org/www.cern.ch ? by cbrocious · · Score: 1

      No no no... they're using the cluster as a cache for websites, so that they don't have to edit the posts when people fuck up links, duh. Don't you know anything?

      --
      Disconnect and self-destruct, one bullet at a time.
  11. CERN link broken by nemexi · · Score: 1

    The CERN link should look like this.

  12. PET-Animals jokes.... by djfray · · Score: 2, Funny

    physicists enable torrent animals pedestrians engulf tree-nesting animals Polka Ensues from Trouncing Animals Police Escape from Tricky Animals Penguins for the Energetic Tazing of Animals

    --
    This sig is o Unfunny o Funny
    1. Re:PET-Animals jokes.... by Anonymous Coward · · Score: 0

      omg those all suck. a lot.

      I want the last minute of my life back... aah I'd only waste it.

  13. ... where the web was born! by Anonymous Coward · · Score: 0

    CERN, Europe's answer to Al Gore.

  14. Images by Limburgher · · Score: 4, Funny

    I found a picture of the system here. You may have to zoom in a bit to see individual machines.

    --

    You are not the customer.

    1. Re:Images by rokzy · · Score: 4, Informative

      your joke being funny not withstanding, that's a map of America, probably the least relevant place to show for this particular project.

      CERN and Grid is European, notably Switzerland, France and UK.

      the USA has plenty of great particle physics of its own (excitable New Yorkers beware - there's a particle accelerator on your doorstep - think of the children!) but this is not one of them.

    2. Re:Images by Limburgher · · Score: 1
      Yeah, I know. That didn't even occur to me until after I'd posted. I'm usually one of the least Yankeecentric (awk?) Americans I know. I just found this image first.

      And, since we're picking nits, that's a photograph, which while you could technically consider it a form of map, is at the same time the most accurate and least useful type of map. :)P

      --

      You are not the customer.

    3. Re:Images by Anonymous Coward · · Score: 1, Informative

      I think the joke works better as a reference to the Hitchhiker's Guide to the Galaxy.

    4. Re:Images by soyuz_2 · · Score: 0

      Quite.

    5. Re:Images by Roger+W+Moore · · Score: 1
      CERN and Grid is European, notably Switzerland, France and UK.

      Actually the CERN member states are a lot more than Switzerland, UK and France. In fact there are lots of Germans and Italians at CERN as well as a whole host of other nationalities.

      Furthermore the Grid is a lot more than just Europe. Speaking as a European, here in Canada we have Grid resources that will be used for the LHC experiments. Even the US is taking part although I understand they are having trouble because the US government is not too happy with US computers being used by us foreigners which sort of defeats the whole purpose of the Grid!

    6. Re:Images by rokzy · · Score: 1

      I didn't say it was just Switzerland, UK and France just mentioned them because CERN is IN Switzerland and France and a lot of the Grid is in UK.

      the E in CERN stands for European. of course there will be other nationalities involved since science is international but it's still a European centre.

  15. Coordination by erick99 · · Score: 5, Interesting
    I wonder how they are coordinating the use of all of those computers? The article doesn't say that they will be exclusively for this project and, if they are not, then that is some task to have them all online and not otherwise busy. They must have some damned serious storage vaults as well if they are generating 15 Petabytes a year of data, which doesn't include the output from processing. Still, it must be something to have all of the "horsepower" at your command.

    Cheers,

    Erick

    --
    http://www.busyweather.com/
    1. Re:Coordination by Anonymous Coward · · Score: 1, Informative

      I wonder how they are coordinating the use of all of those computers? The article doesn't say that they will be exclusively for this project

      Well, GridPP is exclusively particle physics, although there are other grids in construction. Large numbers of people will do large numbers of analyses with the LHC data - it's not just a case of running one job on all the data, it's a case of many jobs and many subsets of the data.

      Globus and digital certificates are also part of your answer.

    2. Re:Coordination by Anonymous Coward · · Score: 1, Interesting

      I wonder how they are coordinating the use of all of those computers?

      Carefully. Well, with some very complex schedulers and batch systems and LDAP directories and SQL databases and and bits from the Globus project and lots of other scripts and random crap. It's kindof a miracle it all works (when it works...), a bit like the Internet itself really.

    3. Re:Coordination by penguinoid · · Score: 0

      How come that picture of the earth does not show stars? Were they purposely removed, or is it an artifact of the software for joining images from several satelites (if that is how it was done)?

      --
      Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    4. Re:Coordination by MrNixon · · Score: 3, Informative

      Because the Earth is a LOT brighter than the stars (because the stars are far away), and to properly expose the Earth onto whatever media is being used(film, CCD, whatever), less exposure is needed than would be necissary to pick up any stars (save the sun).

      Just like pictures from the moon - you'll not see any stars in pictures taken of the moon on the moon (by Neil Armstron et al).

      Hope that helps

    5. Re:Coordination by steve_l · · Score: 2, Interesting

      I have access to some of the machines; we donate idle systems to the project in exchange for low cost (read free) access to the superjanet network. When they arent doing UK NeSC grid stuff I can bring up vmware images of whatever distro I feel like, run whatever stuff we need -in my case usually distributed testing of distributed software.

      That is how the grid works -it uses spare cycles on machines in the network. Unlike Seti@home, they are very fussy about bandwidth; you need a serious link to play. Most of the tier-1 sites are UK academic sites -rutherford labs, oxford, the london universities, etc. Tier-2 sites are us industrial sites with machines we let them play on.

      Like you say, data storage is a big issue, and something the grid needs to work on. A lot of grid forum work is on data.

      Incidentally, when the LHC comes on line, then the serious data starts to collect. Any collisions -events, they call them- generate vast amounts of data. There is some logic in the system to immediately split dull events from potentially interesting ones, but those interesting ones happen often enough you need to buffer it all up, then do more rigorous analysis to see if it is something new or something known about. The uk grid will be used for analysis of stuff the front end thinks could be interesting. Right now it can test the data generated by simulations (people can get phds writing good event simulations), so they can verify that the analysis code works.

      One of the great fear in high energy physics is that the filter and detection logic is buggy and that nobel-grade events are missed because the data is simply too bizarre for the analysis code, and so gets missed out,..

    6. Re:Coordination by Anonymous Coward · · Score: 0

      That's awesome. Who makes the VMware images? Do you make them and then deploy them on the grid? or do you download them?

    7. Re:Coordination by steve_l · · Score: 1

      vmware images are how we (regularly) deploy stuff without caring where it is run. the uk grid images are done differently, by having a bit of dedicated file space on a SAN providing the sys images -and having the blades boot of that bit of the image.

      essentially our blades can reconfigure to boot what looks like a different physical image as fast as you can restart them; vmware is something we run on top for extra dynamicness and load sharing.

  16. Re:MOD DOWN PARENT PYRAMID SCHEMER by Anonymous Coward · · Score: 0
    freeipods is not really a pyramid scheme. Read this wired article for more info:

    Making Free IPods Pay Off

  17. Shortly after revealing their grid.... by rubberbando · · Score: 1, Offtopic

    they found themselves being upstaged by claria or some other spyware company with their legion of zombie computers.. :-P

    --
    DEAD DEAD DEAD DELETE ME
  18. Physics by penguinoid · · Score: 4, Funny

    Getting the physics right has been an important part of many of our favorite 3D games lately...

    --
    Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
  19. Hardon by Anonymous Coward · · Score: 0, Funny
    The Large Hadron Collider Computing Grid

    Did anyone else read that as the Large Hardon Collider Computing Grid, or was it just me?

    1. Re:Hardon by glitch23 · · Score: 1

      Masturbation sucks doesn't it? That blindness just creeps on you but the first sign is dyslexia.

      --
      this nation, under God, shall have a new birth of freedom. -- Lincoln, Gettysburg Address
  20. Largest? by anethema · · Score: 4, Interesting

    I am not sure how they define largest...

    Are these 6000 super computers? Or just other computers?

    Distributed.net had around 330 thousand participants on the latest completed rc5 key.They had 15 thousand active on the last day of the challenge.

    I would say this is much larger in computer numbers, but since they dont mention almost any usefull information in the article, I'm not sure if more computer power would be in the d.net.

    However the line: By 2007, this Grid will have the equivalent of 100,000 of today's fastest computers working together to produce a 'virtual supercomputer', which can be expanded and developed as needed

    So right now it isnt even 100 thousand computers, maybe not even close, so the computing power might be similar. (assuming 15 thousand active computers on d.net)

    Either way, right now i highly doubt its the largest ;)

    --


    It's easier to fight for one's principles than to live up to them.
    1. Re:Largest? by Anonymous Coward · · Score: 2, Informative


      So right now it isnt even 100 thousand computers, maybe not even close, so the computing power might be similar. (assuming 15 thousand active computers on d.net)


      The point is not so much assembling all that computing power now (the LHC won't come online till 2007 or so anyway, and you don't really need the Grid to run Monte Carlo) so much as assembling the infrastructure so that when 100 universities go out and buy new analysis farms in 2007, they can get tied together and used efficiently.

  21. 10? by real_smiff · · Score: 4, Funny
    why a factor of 10? why not take it to.. eleven.

    for when your particle collider needs that little push over the cliff..

    --

    This is my Sig, this is my Gun. One is for Slashdot and one is for Fun.

  22. Copycat writeup by David+McBride · · Score: 4, Informative

    That writeup looks a lot like the one at The Register -- which came out a good two days early, the same day the results were actually announced at the AHM conference.

  23. Large Hardon Collider?! by Hitmen · · Score: 5, Funny

    Erm, I think I read that wrong.

  24. Re:just so people know by Anonymous Coward · · Score: 0, Funny

    ...and also the SI unit for child pornography!

  25. But... by rune2 · · Score: 2, Funny

    Can it run Longhorn?

  26. Seamlessly? I doubt it. Latency is a big problem by Louis+Savain · · Score: 2, Insightful

    Grid computing has been a target for IT developers and scientists for more than five years. It allows scientists to access computer power and data from around the world seamlessly, without needing to know where the computers are.

    The key word here is "seamlessly." The problem with a world grid is the latency introduced by communication between nodes. If a computation is dependent on results from another computation happening half way around the world, I cannot see how a world grid can compete against a linux cluster. Besides, unless there is provision for redundancy (sorry, I did not read the entire article), a critical node may be down due to a power outage or something as mundane as the cleaning people turning off the computer. This would bring everything to a halt.

  27. Har har.. by Anonymous Coward · · Score: 0

    like we don't see that *every* time a hadron collider shows up..

  28. Re:Seamlessly? I doubt it. Latency is a big proble by Anonymous Coward · · Score: 0

    If a computation is dependent on results from another computation happening half way around the world, I cannot see how a world grid can compete against a linux cluster.

    Think superscalar execution strategies in CPUs scaled up - got a branch dependency, compute both branches and cancel the one that doesn't apply...

  29. The link at bottom by logicnazi · · Score: 1

    Why is there a link to some crackpots theory of physics at the bottom of this article? Is this not a reputable source?

    --

    If you liked this thought maybe you would find my blog nice too:

  30. One tiny problem ... by Anonymous Coward · · Score: 2, Interesting

    One of my buddies was an early numerical modeller. If I learned one thing from him it was that all the computer power in the world was no use if your model was even slightly defective. The models tended to 'blow up'. Imagine a hundred foot wall of water moving majestically down the estuary.

    Typical of stories about these giant computers, they don't really describe the problems they intend to solve. In a way, that is the more interesting story. Mind you, that story is much harder to tell if you want your audience to understand it.

    1. Re:One tiny problem ... by Anonymous Coward · · Score: 0

      Well in this case, the computers will be solving lots of different problems, you establish "virtual organisations" [VO] on the grid infrastructure and sites sign up to various VOs in a you-scratch-my-back-i'll-scratch-yours relationship.

  31. Super big "grid"!? by ylikone · · Score: 2, Funny

    Imagine if they had a super big worldwide "grid" of computers all connected via some common protocol! It would be amazing!

    --
    Meh.
    1. Re:Super big "grid"!? by DJCF · · Score: 1

      I think DARPA tried that a few years ago, but then the academics took it over.. Can't quite remember what it was called though - any ideas?

    2. Re:Super big "grid"!? by Anonymous Coward · · Score: 0

      Globus provides an implementation of OGSA/OGSI and soon WSRF, all protocols developed for grid computing. The Global Grid Forum meets regularly (at conferences) to decide on standardization of grid protocols.

      Note that just because the grid protocols are being standardized does not mean anyone can have access to one "giant grid". It just means that heteregeneous sites are able to interoperate, authentication/authorization control is up to the participating sites' local policies and via virtual organizations which can be (simply) thought of as aggregates, the 'master' groups (but VOs can be much less coarse than that).

      There is a lot of advanced work being done in this area, see:

      http://www.globus.org/
      http://www.ggf.org/

  32. Could be worse by DigiShaman · · Score: 1

    They could have had to cut down entire forests for the paper needed to do the math by hand.

    --
    Life is not for the lazy.
  33. worlds largest working grid??? by jimmysays · · Score: 3, Informative

    I was under the impression that the world's largest working grid was the United Devices grid.org project. They have over 2.5 million registered users and average over 300,000 work units returned every day. check out www.grid.org They are also doing real science.

    1. Re:worlds largest working grid??? by UranusReallyHertz · · Score: 1

      Seeing as all the participants in all the public distributed computing projects only ever communicate with the central server it isn't very accurate to call them grids. More like a many spoked wheel without a rim. I assume the computers in this project will comunicate with each other in a P2P fashion.

      --
      Smoking is an expensive, slow, and unreliable method of suicide.
  34. No it didn't. by cbreaker · · Score: 1

    nt

    --
    - It's not the Macs I hate. It's Digg users. -
  35. Re:MOD DOWN PARENT PYRAMID SCHEMER by Anonymous Coward · · Score: 0

    /. != place for people to whine about people posting links for things in their sigs. /. = place where (some) smart people come, and can decide whether or not to click a link, and whether or not to participate in something

  36. Re:Seamlessly? I doubt it. Latency is a big proble by tkittel · · Score: 4, Interesting

    True, and this makes it difficult for people who want to calculate protein folding or predict next weeks weather. But for particle physics computations we hardly need any communication between nodes at all. Rather, we need something simulated a huge amount of times (as in, "simulate this proton-proton collision 10 billion times") or "apply this fancy pattern recognition algorithm to each of these billions of events we took this week". Particle physics computations are to a large extent parallel in nature from the beginning.

    The grid related problems faced in particle physics are of another nature, such as ensuring that the data is copied around the various grid facilities as needed and of ensuring that even if a given node fails to execute its job for some reason it is rerun elsewhere automatically - that sort of thing.

  37. Oh no by mcryptic · · Score: 1

    Is anyone else thinking here comes the Forbin Project!?

    1. Re:Oh no by Captain+DaFt · · Score: 1

      Or for the less literate; Skynet?

      --
      The U.S. really needs an English to Wisdom dictionary.
  38. Re:Seamlessly? I doubt it. Latency is a big proble by Louis+Savain · · Score: 1

    The grid related problems faced in particle physics are of another nature, such as ensuring that the data is copied around the various grid facilities as needed and of ensuring that even if a given node fails to execute its job for some reason it is rerun elsewhere automatically - that sort of thing.

    I appreciate your input on this matter. I tend to look at things from an AI/neural network perpective. So I thought, there is no way a brain could be simulated on a world grid because timing is crucial to the brain's operation. However, I can see where repetitive computations on isolated (although related) problems can benefit immensely from a world grid. Thanks for clarifying this.

  39. How long... by Dorsai65 · · Score: 1

    til we can get this as a laptop? And can you do something about the battery life?

    --
    --- Asking inconvenient questions for over 30 years...
  40. heh heh by Anonymous Coward · · Score: 0
    <butthead mode="on" >
    dude, did he just say "large hardon"?
  41. One future quote: by tod_miller · · Score: 3, Funny

    640 petabytes of memory should be enough for anyone, ever.

    Although, if 640kb sounded anything like 640 petabytes does now, I'll have to rape moores law over a barrell and say I doubt we will ever have computers with 640petabytes of ram as standard.

    Of course, I say that in jest, I would love for future people to read this post and laugh thier tits off (some futuristic velcro tits no doubt)

    --
    #hostfile 0.0.0.0 primidi.com 0.0.0.0 www.primidi.com 0.0.0.0 radio.weblogs.com
  42. How long until Skynet ? by Anonymous Coward · · Score: 0

    How long until there are so many of these connected online that it becomes self-aware and tries to kill humanity off ?

    If this thing gets infected with NetSky what happens to civilisation ?

  43. You have Americas in the picture!!!1!!! by Anonymous Coward · · Score: 0

    You'll have to zoom very hard since CERN is in Switzerland.

  44. no other way? by Anonymous Coward · · Score: 0

    i was just thinking, why don't they put this
    LHC detector thingy on a scale and if they acctually
    get this higgs boson thing in the detector the
    detector machine would gain some mass, e.g. would
    get heavier ... wouldn't that work?

    1. Re:no other way? by Anonymous Coward · · Score: 0

      Dude, you didn't get it...
      This thingy IS the scale - and a quite sophisticated one at that.

  45. details by Anonymous Coward · · Score: 0

    Check out these links for details, there is a lot of work in this area. Comparing this to @Home type projects is the wrong way to go... each node on the grid can be a gatekeeper to a cluster, where a parallel job is run. The problems involved are more complex than what a centralized server/organization can take care of.

    http://www.globus.org//
    http://www.ggf.org//
    http://www.globusworld.com//

    Some details.. much more out there.
    http://www.grids-center.org/news/clusterworld//
    http://www-106.ibm.com/developerworks/grid/library /gr-design.html/
    http://www.casa-sotomayor.net/gt3-tutorial//

    Plus, lots of academic papers out there.. this is a pretty interesting subject.