Slashdot Mirror


How to get 1.5 TeraFlops from Linux

Oak Ridge National Lab has purchased from SGI an Altix 3000 (flash movie). This article claims that: SGI Altix 3000 is recognized as the first Linux cluster that scales up to 64 processors within each node and the first cluster ever to allow global shared memory access across nodes. There is more here, here, and here.

22 of 280 comments (clear)

  1. Look Out! by TWX · · Score: 4, Funny

    "SGI Altix 3000 is recognized as the first Linux cluster that scales up to 64 processors"

    SCO will be all over your ass now!

    --
    Do not look into laser with remaining eye.
    1. Re:Look Out! by monkey_jam · · Score: 4, Funny

      ..maybe you should learn to wipe better...

  2. Beowulf cluster jokes... by Kiriwas · · Score: 5, Interesting

    After all the beowulf cluster jokes, I am still incredibly curious about them. My goal is to build a small 5-6 node cluster by the end of the summer. The thing is, I still know very little about them. Every jokes about them, but no one puts any useful information. Are there specific langauges one must program in to tak advantage of the multiple processors? Or does the OS take care of that? How much speed can you actually get out of them? Is it pure processing power? Or is there more? I'm very curious and want to know.

    1. Re:Beowulf cluster jokes... by gladbach · · Score: 5, Informative

      just download clusterknoppix and knock yourself out. ; )

      http://bofh.be/clusterknoppix/

      --
      "Computer games don't affect kids; I mean if Pac-Man affected us as kids, we'd all be running around in darkened rooms,
    2. Re:Beowulf cluster jokes... by The_ForeignEye · · Score: 5, Informative

      Back in my days of parallel programming (read: 1998) on Beowulf clusters I used Fortran and C. The trick to make your program "parallel" is to use special programming libraries that will spawn instances of your program across the cluster and let them communicate between each other. The libraries I used were PVM and MPI.

      At that time they were working on a Java implementation, but I don't know what happened with that.

  3. Apple by zzzmarcus · · Score: 5, Funny

    Oh great... I can see Jobs wringing his hands already.

    "Now how am I going to make the G5's look faster than THIS?"

  4. kernel sources? by gladbach · · Score: 5, Interesting

    they going to release their kernel that allows them to globally share memory? or is it more of a hardware thing, than software?

    --
    "Computer games don't affect kids; I mean if Pac-Man affected us as kids, we'd all be running around in darkened rooms,
  5. Better than Beowulf for normal use... by TWX · · Score: 5, Informative

    You're better off using mosix. It'll allow for more normal (ie, not beowulf specific) applications to thread across computers. I'd imagine that an open-mosix setup (like the ones using the knoppix boot CDs tailored to it) could probably make for a fairly powerful computing cluster very easily.

    --
    Do not look into laser with remaining eye.
    1. Re:Better than Beowulf for normal use... by ERJ · · Score: 5, Informative

      Mosix is nice, because it treats the cluster like a single, large, multi-cpu box by simply allocating threads to different boxes. The nice thing about this is that any multi-threaded program can take advantage (as stated in the parent post).

      However, this also can cause problems. Most threaded programs are written assuming that all the threads have high speed (i.e. system bus / cpu cache) access to shared information. When we introduce the latency incurred by a network, this can cause programs to run alot slower then they would if they simply had all the threads on a single box. Obviously, it all depends on how the program was written, and what it does.

      If you are writting a program specifically for a cluster, I would suggest instead looking at something like LAM-MPI. This allows for a much more controlling approach to be taken. It is more work (you have to decide how the work will be split) but it allows for much better control of where and what is being done and how to optimize it.

  6. Rocket Haid... by poptones · · Score: 4, Funny
    Now those obsessed geniuses have even more reason to forget to change the oil in their cars...

    (Inside joke for my ol' friends at ORNL...)

  7. SCO and Microsoft reactions? by mao+che+minh · · Score: 5, Interesting
    I wonder what kind of FUD Microsft and SCO will cook up to try to thwart this new display of raw power. McNealy seems intent on not only winning the Asshat award, but outright retiring it in his honor.

    It's funny that Microsoft always tries to downplay Linux's enterprise capabilities, when Linux has been scaled to far more power then Microsoft's best offering for years now. Windows 2003 is a clumsy, bloated, closed source chunk of green crap.

  8. Yanking from my journal entry of 6/30/03 by anzha · · Score: 4, Informative

    HPC Wire had an article that I referenced in my journal on 6/30.

    It's an interesting machine. I'd love to get one to play with. I'm sure our benchmarkers will have some even more interesting comments once they're done. Expect teething problems, folks. Systems of this size and complexity take time to break in.

    --
    Do you know why the road less traveled by is littered with the bones of the unwary?
  9. Obligatory: Mods on Crack! by panda · · Score: 5, Funny

    OK, so the moderators are on crack today. What's with all these obviously "funny" posts getting moderated as "insightful?"

    Guess it's time to meta-moderate!

    --
    Just be sure to wear the gold uniform when you beam down -- you know what happens when you wear the red one.
    1. Re:Obligatory: Mods on Crack! by darkov · · Score: 5, Funny

      OK, so the moderators are on crack today.

      Only today?

  10. Oops (RTFA) by Anonymous Coward · · Score: 5, Informative

    The machine has 256 processors for 1.5 teraflops, not 64.

  11. Conversion scale? by jackDuhRipper · · Score: 5, Funny

    What's that in bogomips?

  12. SGI: Unsung coorporate heros ? by Anonymous Coward · · Score: 5, Interesting

    Perhaps this will finally get SGI's Open Source Software efforts in the spotlight.So far every other major hardware vendor has jumped the bandwagon making a lot of noise, and trying to get free publicity. SGI however has always quietly contributed large amounts of knowledge but always in a modest or even shy way (sometimes even publicly denying involvement, but working in secret :) ).
    In the meantime their additions have contributed quite a bit to open en free thinking in software, take OpenGL and open Inventor, or even to the kernel directly as with the XFS filesystem.
    I always liked this approach more than the hyping others have done with linux, but unfortunately this has kept them unadorned within the community. With the Altix cluster (as with their GNU/Linux workstations,which unfortunately failed) I think they have shown that they put their money where their mouth isn't.

    I think it's only fair that when we are talking about the large coorporate players in the OSS field SGI at least deserves a footnote for their efforts instead of just hammering exclusively on IBM,Sun etc..as the great backers.

    I know, I know. It's a coorporation, so they inherently put money over freedom, it's just something I noticed because of the lack of their name in any high-profile discussions, which I think is unfair.

  13. And just how did they accomplish this... by Kevinv · · Score: 4, Funny

    without SCO's help?

  14. Re:Hey, at least it's not running IRIX by Chicane-UK · · Score: 4, Informative

    Um..

    I always liked Irix, and everyone I ever talked to who used Irix liked it. The GUI is about 500x more usable than the horrors of OpenWindows or CDE on Solaris.. bleugh.

    --
    "Hey! Unless this is a nude love-in, get the hell off my property!!"
  15. Re:lites by CoolVibe · · Score: 5, Interesting
    I've experienced it the other wat around once. At some previous $workplace, we had this humongous SGI Origin 3800 cluster. Due to a city-wide brown out, and due to the fact that we were just installing the diesel-powered generators, the thing had to survive for a couple of hours on the nobreak. Sure, all the lights in the building were out, but the behemoth was still churning. We (the venerable sysadmins) were trying to decouple a partition so we could hook up a console to ot to bring down the thing gracefully. Of course, that wasn't that easy.

    Suddenly the nobreak was all out, and the billion dollar machine went *poof* - down. Damage? A couple of SCSI disks, but of course everything was mirrored and had parity so even with the damaged disks, there was no data loss.

    Then (after a few hours) the powerfaillure ended, the lights went back on in the building, but the lights on the big cluster were still off. The other way round than you'd like to see. Although, when the building power was out, and the nobreak for the machine was active, it sure was a pretty sight. Although, with the impending doom, I didn't really have time to appreciate it.

  16. Setting one up now by jimshep · · Score: 5, Informative

    We just got ours installed yesterday. I'm still installing software and am starting benchmarks. It's only the deskside version (12 cpus, 24GB RAM, 1TB disk), but still more powerful than the 4-cpu SGI Origins that we have been using.

    It is the first one that the regional SGI reps had actually installed, but since it is almost exactly the same as the MIPS-based origin 3000 servers (with the exception of the obviously different Itanium 2 cpus and supporting chipsets), they ran into almost no problems getting it online. I have also been suprised as to how many commercial codes have already been ported to the platform.

    The main reasons we purchased this machine is for the ease in parallelizing code and the floating point performance of the Itaniam 2 cpus. We're computational materials engineers and the less time we have to spend optimizing codes so that the nodes of a cluster are always kept busy and minimizing I/O bottlenecks gives us more time to concentrate on the theoretical issues.

    It runs RedHat 7.2 with some tweaks by SGI called SGI ProPack. The Propack modifications come on separate CDs, with the proprietary software on separate CDs from the open source software. So far, from the command line, everything works just like my PC. It's kind of strange running Linux on a >$100K machine, but it sure beats dealing with the annoying differences between IRIX and Linux. Now to see if it performs as well as we expect...

  17. Re:lites by Leebert · · Score: 4, Informative

    the billion dollar machine

    What the hell kind of Origin 3800 do YOU have? ISTR ours (512-proc) was roughly $10M.