Slashdot Mirror


Coolest Cluster Ever

sw155kn1f3 writes "Scientists at Los Alamos National Laboratory built a cheap (less than $1k per unit) 294-unit Beowulf claster dedicated to run astrophysics calculations. According to their website it's 85th fastest computer in the world. Seems cool and promising as it made with cheap components and off the shelf hardware."

30 of 279 comments (clear)

  1. Imagine... by Anonymous Coward · · Score: 5, Funny

    Imagine a single unit of these...

  2. Obligatory by BSDevil · · Score: 4, Funny

    Imagine a Beowulf cluster of these...Beo...shit - I knew this joke would have to end at some point.

    --
    Cue The Sun...
    1. Re:Obligatory by paganizer · · Score: 3, Funny

      Oddly enough, I was just going to make the exact same post. Thank you for sparing me. Freenet IS the hope of the future

      --
      Why, yes, I AM a Pagan Libertarian.
  3. Uh oh by Eric(b0mb)Dennis · · Score: 3, Insightful

    Astrophysics.... 85th largest in the world... Call the department of homeland security, this could be terrorism! Yeah, okay.. it was stupid :P

    --
    Excuse me, I don't mean to impose, but I am the ocean
    1. Re:Uh oh by MoThugz · · Score: 3, Funny

      Yeah, it's stupid... as you can see from the article itself, everyone involved in that project has a @*.gov email.

      Sheesh...

  4. And they used Shuttle XPC SS51Gs! by Max+Romantschuk · · Score: 5, Informative

    They didn't even use a rack mount solution, they used regular Shuttle XPC SS51G Mini-PCs

    I thought Shuttles Mini-PCs were cool before but this really resets the scale... Now where is the HOWTO for this thing? ;)

    --
    .: Max Romantschuk :: http://max.romantschuk.fi/
    1. Re:And they used Shuttle XPC SS51Gs! by ryochiji · · Score: 5, Funny
      > They didn't even use a rack mount solution

      I was thinking that too when I saw the picture. I mean, how are they securing those boxes? The way it looks, I certainly wouldn't want to be standing near that rack when an earthquake hits...

      But then, imagine: Cause of death: crushed by Beowulf cluster. That's a geek's dream come true!

  5. Um, how does that make it the 'coolest'? by autopr0n · · Score: 5, Insightful

    I don't really think you can really quantify coolness in general, but I fail to see how the fact that this thing is cheap makes it all that cool.

    Perhaps if it was going to run simulations of ultra-low temperature physics... get it? haha. I kill me.

    --
    autopr0n is like, down and stuff.
  6. For less than $300,000... by TWX_the_Linux_Zealot · · Score: 4, Interesting

    It would be possible for a group of people, not necessarily a small group, but not necessarily huge, either to repeat this. 100 people, each with $3,000, could do it. The group would need to find some space to house the thing, and would probably have to do it in a climate where it could be relatively naturally cooled, which definitely rules out Phoenix. The computer would then be one of the fastest machines in the world.

    Granted, I don't know what the hell they'd do with the computer, but it would be kind of cool to be on the list.

    --

    IBM had PL/1, with syntax worse than JOSS,
    And everywhere the language went, it was a total loss...
  7. Re:Wow by Max+Romantschuk · · Score: 5, Informative

    and a "heat pipe" instead of a fan!

    Actually, the heat pipe doesn't replace the fan, it just lowers the number of fans used in the system, since the case and processor fan can be combined.

    Tom's Hardware has a review of one of these things (not the same model though)... have a look.

    --
    .: Max Romantschuk :: http://max.romantschuk.fi/
  8. Re:Not that impressive by tgrotvedt · · Score: 3, Interesting
    C'mon....

    For $294,000US, this has to impress you.

    All of the top 10 fastest computers in the world are multi-multi-million dollar machines. This is a breakthrough because it represents another milestone in bringing supercomputing accessible.

    $264k one day, $100k the next. I sincerely hope that soon small-to-medium enterprises can own supercomputers. With all the low budget physics stuff going on at Universities around the world, cheap supercomputing can only be a good thing.

    --
    What makes a man want to be a mouse? (Python's Flying Circus)
  9. 1000 machine beowulf cluster by SystematicPsycho · · Score: 4, Interesting

    Take a look at this room A 1000-Pentium Beowulf-Style Cluster Computer half way down the page.

    --
    Analytic & algebraic topology of locally Euclidean meterization of infinitely differentiable Riemmanian manifold
  10. Whoah.. by Anonvmous+Coward · · Score: 3, Funny

    "According to their website it's 85th fastest computer in the world. Seems cool and promising as it made with cheap components and off the shelf hardware."

    I'm guessing the story submitters ran out of anti-MS ammo tonight. Heh.

    It's satire, laugh.

    1. Re:Whoah.. by enneff · · Score: 4, Funny

      I thought satire was supposed to be funny.

  11. Like all government news... by dethl · · Score: 3, Interesting

    Last modified: November 15, 2002

    We are the last to know about it :P

    --
    "Some fight for law. Some fight for justice. What will you fight for? One day, you will see."
  12. Hmm... by lvdrproject · · Score: 5, Funny
    1. Create Beowulf cluster
    2. ???
    3. SLASHDOT!

    Laugh, it's a joke.

    :Lav

  13. Or.... by raehl · · Score: 5, Funny

    They could spend their $3k on something actually needed by 100 people thinking about spending $3k to share a spot on a fastest computers list.

    Like a prosititute.

    You go to your high school reunion, what's, more impressive, the "Hugh Hefner" 100 $3k prostitutes that come with you, or the "Bill Gates" story about the 300 1k computers in your mom's basement?

  14. 85th Fastest in the World? by serutan · · Score: 4, Funny

    The photo alone is worth surfing over to the article. As Socrates once said, "what a rack!"

    But now that they've got the 85th fastest computer, what will they have to do to maintain that coveted position? I imagine the people who are running 86th are rushing out to buy more nodes. My own computer is the world's 27,385,422nd fastest, and I'm battling like crazy to get to 27,385,421. :-)

    1. Re:85th Fastest in the World? by The+Wooden+Badger · · Score: 3, Funny
      My own computer is the world's 27,385,422nd fastest, and I'm battling like crazy to get to 27,385,421.

      I'm not going down without a fight.

      --
      Heroscape, it's like legos combined with anachronistic wargames.
  15. Re:Why build one anymore? by Cryptnotic · · Score: 3, Interesting

    Not to mention national security issues. LANL has had many problems with security in the last few years.

    --
    My other first post is car post.
  16. Think again - EDA tools prove this wrong by StandardCell · · Score: 3, Interesting

    At the semiconductor company where I work, I'm finding most of the EDA tools are being ported from expensive Sun Ultrasparcs to P4/Athlon-based commodity platforms with Linux OSes. And guess what? The processor clock speed has a direct correlation with performance compared to the slow-poke Ultrasparc 3s. You can reach a memory limit for some operations, but tools like Magma and our internal tools that are ported are running at least twice as fast per processor. Particularly with hierarchical designs, the only time the Sun Servers become necessary is for all the back end physical verification, parasitic extraction and signal integrity analysis, where less users are interactively spending their time anyway versus the floorplan/place/route anyway. So, whether I go out and buy an E4500 with 6 processors and 20GB of memory and use LSF, or I buy a dual Xeon 2.4GHz with 4GB of ECC and a Seagate HD, I'm getting a hell of a lot more mileage out of the dual Xeon and a huge cost benefit too for 10% of the entry cost of the Sun.

    Sorry, but commodity PC hardware really does have a place in real computational work on the design of multimillion-gate standard-cell ASICs like the ones going into the latest Nvidia and ATI cards. The Suns are, for now, necessary, but it won't be long until commodity hardware usurps its place for a fraction of their overpriced niche monopoly in EDA tools.

  17. Sure, off the shelve cheap stuff... by dr.Flake · · Score: 3, Interesting

    I really like the picture on the sites frontpage.
    i can imagine the small size of the Shuttles being an advantage, not to mention the "coolness" factor looking at it. (i assume the "cool" in the intro refers to emotion and not teperature!!)

    But getting computation done cheap is no longer the challenge. It's getting the data from one node to the other. They still need "custom" expensive equipment for this.

    I see they use 3com gigabit ethernet. having this 300+ gigabit switch capability is not "cheap".

    Until one can buy this kind of networking equipment for really cheap, we shouldn't mention things like "of the shelve Beowulf super computer in the top 100".

    --
    Why are other peoples sig's always more witty ???
    1. Re:Sure, off the shelve cheap stuff... by tconnors · · Score: 5, Informative

      I really like the picture on the sites frontpage.
      i can imagine the small size of the Shuttles being an advantage, not to mention the "coolness" factor looking at it. (i assume the "cool" in the intro refers to emotion and not teperature!!)

      But getting computation done cheap is no longer the challenge. It's getting the data from one node to the other. They still need "custom" expensive equipment for this.

      I see they use 3com gigabit ethernet. having this 300+ gigabit switch capability is not "cheap".

      Until one can buy this kind of networking equipment for really cheap, we shouldn't mention things like "of the shelve Beowulf super computer in the top 100".


      Up until 3 hours ago, we said we were the only machine in the top500 dedicated solely to astrophysics. Now we are one of 2 :)

      But we use 180 processors, @ 2.15 GHz, and get about 0.90 Gflops/processor, whereas they get about 0.88 gflops/proc, getting us in the top 180th.

      The difference being they have faster memory, and we have a big badass switch. They have two switches, with something like only 10 gigabit between the switches! We have 250gbit within our one switch. a third of our nodes have 2 gigs RAM, and we also have room for upgrade to more nodes on our switch, and they don't. So, in the words of Nelson "Hee haw!" :)

      When they say $1000 per proc, they are not factoriing in their two switches. This will bring the price up to about $500,000, unless someone is donating a switch or 2 :)

      We have about the same cost ratio - something like 250,000 .au dollars for all our procs (and maybe switch - I don't know the details) - half the performance, half the cost.

  18. Re:Not that impressive by BWJones · · Score: 4, Informative

    I sincerely hope that soon small-to-medium enterprises can own supercomputers. With all the low budget physics stuff going on at Universities around the world, cheap supercomputing can only be a good thing.

    Actually they can with software like that from Dauger Research, Project Appleseed and Wolfram Research with gridMathematica

    The cool thing here is that this code can be run on all of the desktop computers that already occupy companies and universities world wide allowing for easy access to supercomputer level computational speed (for those problems that can be attacked using parallel computation of course) using the same computers normally used for productivity.

    Very cool.

    --
    Visit Jonesblog and say hello.
  19. Do you need a hard drive in each node? by Xenolith · · Score: 3, Interesting

    Disclaimer: I have never built a cluster before.

    What is the advantage of having a hard drive in each node. Can't you boot each node off of a networked image and load the OS and whatever "work" into memory.

    thanks

    --

    Journal
  20. Re:cheap clusters can also be bad by Moses+Lawn · · Score: 3, Funny

    Ladies and gentlemen, we have a replacement for Jon Katz...

    --

    What if life is just a side effect of some other process and God has no idea we exist?

  21. Slashdot culture archive by 0x0d0a · · Score: 3, Interesting

    Has anyone ever written a Slashdot culture archive? Slashdot has a pretty rich and entertaining culture, and I hate to see things like Natalie Portman, Beowulf, and goats.cx...well, maybe not goats.cx....vanish forgotten into the mists of time. I've tremendously enjoyed cultural archives of USENET, where various trends or customs were explained, with links to example text.

    I'd love to read something like this, if anyone ever gets around to setting up a website to archive these.

    It's very difficult to identify trends (like, say, what the meaning of hot grits is) long after the fact -- you're looking at hundreds of thousands of old tech posts. But if someone is thoughtful enough to make a note that this is happening...well, five or ten years from now, it could be quite a fun to read little work.

  22. Where do yo swap... by anonymous+cupboard · · Score: 3, Informative
    Back in the days when I was working with LAVCs (Local Area VAX Clusters) over 10-Mbit Lans, diskless systems were possible but any disk I/O hit the bandwidth of the entire network. Pageing could murder the system. Also for larger clusters, simply loading the system on a number of machines took time as a mass storage server can only serve one system per request.

    Ok, modern LANs, especially this one is a lot faster, but you still don't want to burden your cluster communications bus with disk I/O requests.

    Anyway, that 80 gig Maxtor does not add much to the cost of the node.

  23. Re:What about the first 84? by shri · · Score: 3, Informative

    http://www.top500.org/

    (Dammit .. I have to wait 20 seconds before I hit submit!)

  24. Re:Topology? by tconnors · · Score: 4, Interesting

    What's the bandwidth of that trunk? Also, what's the capaity of the connections between each 16-port card and the backplane?

    Just curious... suppose all the units on a 16-port card have 1Gbps each, but only 8Gb total to the backplane. Then the backplane, in turn, has only 8Gb to the other switch. These are just made up numbers, but how would beowulf handle it? Can it group jobs requiring higher communication throughput onto the nodes which are closer to eah other? Does it have to be told the topology, or does it figure it out?


    Sounds like they have 10 ports @ 1Gbit each free, so get about 10Gbit between the switches. When we (position 180 on the latest top500) were investigating thin-tree connections, we thought that we might be able to effectively run one job on a third of the nodes, another on the second third, and miscellaneous jobs on the 3rd (since we have two or 3 researchers who like to use lots of resources, and people like me who only need a single proc at a time). So you just partition the nodes and only allow your mpi jobs to sit on one group at a time.

    Then there are things like openmosix which deal with topology automatically somehow. They will try to calculate the speed of the interconnect and the various nodes' procs (if heterogenous), and work out the distribution in the most efficient way. I am going to try to convince my sysadmin to try out openmosix on the lesser-used nodes of the cluster, because there is a feature of it that I think one of us might like - the combination of memory of the different nodes in one big contigous space, but right now we are busy cleaning up after the upgrade.