Slashdot Mirror


SGI & NASA Plan 10240-Processor Altix Cluster

green pizza writes "NASA has announced plans to cluster twenty 512-processor Silicon Graphics Inc Altix supercomputers connected to a 500-terabyte SGI InfiniteStorage SAN. The Altix uses Itanium2 CPUs running Linux atop an Origin 3000-derrived architecture. NASA and SGI scaled Linux to 512 CPUs late last year. There are also strong hints that SGI plans to bring its clustered ATI graphics to Altix in the near future. Lots of neat big iron project on the horizon!"

45 of 202 comments (clear)

  1. What would this be used for? by notbob · · Score: 4, Insightful

    What would you do with 10k processors hooked up to 500 terabytes? Sounds like you could replace every machine Nasa has with an account on this thing.

    Sounds quite insane, I'd love to see the practical reasons for this.

    1. Re:What would this be used for? by turgid · · Score: 4, Funny
      Sounds quite insane, I'd love to see the practical reasons for this.

      With the heat given off by all those itanics, I'm sure they could do some pretty good real-word research into heat shield materials and rocket engine nozzles.

    2. Re:What would this be used for? by MoonFog · · Score: 4, Informative

      NASA has picked computer maker Silicon Graphics Inc. and chipmaker Intel to develop a major supercomputer based on Linux to simulate space exploration and conduct other research, SGI announced Tuesday.

      Read it here

    3. Re:What would this be used for? by christophersaul · · Score: 2, Funny

      Calculating things very quickly maybe? Just a thought. 500TB? I've never seen the need for more than 640k.

    4. Re:What would this be used for? by Anonymous Coward · · Score: 2, Funny

      Put windows me on it and see how many times you can open and close Photoshop before you run out of memory.

    5. Re:What would this be used for? by RPI+Geek · · Score: 3, Informative

      RTFA:
      By boosting its computing capacity ten-fold through Project Columbia, the NASA Advanced Supercomputing Facility (NAS) will be able to more effectively handle such critical projects as simulating future space missions, projecting the impact of human activity on weather patterns, and designing safe and efficient space exploration vehicles and aircraft. The present collaboration builds upon the highly successful 8-year partnership that last year developed the world's first 512-processor Linux server - based on standard, "off-the-shelf" microprocessor and open source technology - the SGI Altix at NASA Ames Research Center named 'Kalpana' after Columbia astronaut and Ames alumna Kalpana Chawla.

      Modeling and building on a business relationship.

      --

      - "Nobody came out that night, not one was ever seen. But Old Man Stauf is waiting there, crazy sick and mean!"
    6. Re:What would this be used for? by Timesprout · · Score: 5, Funny

      For the conspiracy theorists who believe the moon landings were faked a collaboration between NASA and SGI on simulated exploration will just provide a basis to think that the Mars missions will not only be faked, they wont even use real actors next and the whole mission will be CGI.

      So when we do 'land' on Mars, if the astonauts burst into a song and dance extravaganza during the planting the flag ceremony then the job was probably outsourced to India. If the ceremony involves a 10 hour trek up a mountain and is interrupted by hordes of attacking Martians that must be defeated by the 6 astronauts then they probably got Peter Jackson to do it. If the whole mission is really lame and not quite what you were hoping for, look no futher than George Lucas.

      --
      Do not try to read the dupe, thats impossible. Instead, only try to realize the truth
      What truth?
      There is no dupe
    7. Re:What would this be used for? by Stephen+Samuel · · Score: 2, Funny
      What would you do with 10k processors hooked up to 500 terabytes?

      It can do realtime hologram movies, and pop the popcorn while you're watching it.

      --
      Free Software: Like love, it grows best when given away.
    8. Re:What would this be used for? by DAldredge · · Score: 3, Funny

      You know that WOSH! you just heard? That was the sound of the fscking joke going right over your head.

      There should be an IQ test before one is allowed to post to /. I reached this conclusion when I was told I was new here and shouldn't respond to trolls. The user sending me the email had a UID about the level of yours.

  2. Good News for intel by turgid · · Score: 4, Funny

    This is great news for intel. They will double the number of itanics shipped in a single deal!

    1. Re:Good News for intel by Agent+Green · · Score: 3, Insightful

      Good news for Intel indeed, but wouldn't the same deployment with AMD Opterons been cheaper AND faster??

      --
      // Agent Green (Ian / IU7 / KB1JQO)
      // IEEE 802.3: All 10base Are Belong To Us
    2. Re:Good News for intel by musikit · · Score: 3, Funny

      aye but they most likely would have spent the saved money on air conditioning.

    3. Re:Good News for intel by Wesley+Felter · · Score: 3, Insightful

      Itanium has better floating-point performance than Opteron, although the price/performance is worse. There are no 512-way Opteron systems; maybe NASA likes to write shared-memory parallel applications.

    4. Re:Good News for intel by cnkeller · · Score: 4, Informative
      Good news for Intel indeed, but wouldn't the same deployment with AMD Opterons been cheaper AND faster??

      Well, until the final numbers come out, we aren't speculating on performance. Needless to say we hope to claim the top slot in computing power. Also, keep in mind that parts availability is a major concern. We are assembling the system to be fully up and running by SuperComputing '05 in November. Intel has fully committed to delivering all 10K CPU's with no problems. Also, perhaps the biggest reason for Intel, is SGI was chosen as the vendor and they use Intel.

      --

      there are no stupid questions, but there are a lot of inquisitive idiots

    5. Re:Good News for intel by cnkeller · · Score: 3, Informative

      Sigh, that's Supercomputing '04 in November. Of this year. Sorry about that.

      --

      there are no stupid questions, but there are a lot of inquisitive idiots

    6. Re:Good News for intel by Anonymous Coward · · Score: 2, Interesting

      This is great news for intel. They will double the number of itanics shipped in a single deal!

      yes, for sure. they bought a congressman to make this happen. (no joke, trust me.)

      and as usual, real science at nasa is going to suffer for a waste money on unneeded computing capacity just so the US can prove we have a bigger dick than the japanese.

      -pissed off nasa worker

    7. Re:Good News for intel by ajlitt · · Score: 2, Informative

      Really? Considering the Opteron 850 maxes out at 89W while the Itanium 1.5 is 107W, by each vendor's own datasheets.

    8. Re:Good News for intel by Shinobi · · Score: 3, Interesting

      Agent Green:

      Cheaper? Not likely, you'd have to buy the high-speed interconnect to make it worthwhile. And the Opterons perform fairly poorly in larger clusters, since they have the NUMA latency penalties locally on each node. Checking the Top500 list, a cluster of 256 Opteron 246 using Infiniband will perform worse than a cluster of 256 Xeon 2.8GHz using Infiniband. The scariest example is that a cluster of 256 P4's@3GHz using Gigabit Ethernet outperforms the Opteron cluster.....

      Important to note is that the Linpack test doesn't stress the interconnect that much. The more a task stresses the interconnect, the more the Opteron cluster will be penalized. There's one exception though, and that's the Cray Octiga Bay systems.... And if you go that route, it costs _at_ _least_ as much as an Altix system

    9. Re:Good News for intel by turgid · · Score: 4, Informative
      There are no 512-way Opteron systems; maybe NASA likes to write shared-memory parallel applications.

      Not yet, but Cray is working on it in something called Red Storm.

      Itanium's "better" floating point performance than Opteron is confined to some pretty specialised benchmarks. Over all, Opteron is a more efficient design, runs cooler than itanium, has better compilers, better software support, is cheaper and had more room to scale to much higher clock speeds.

    10. Re:Good News for intel by turgid · · Score: 2, Informative
      Isn't Cray just a division of SGI now?

      No, SGI bought part of Cray a few years back and Sun bought another part (that's where the Sun E10k came from). SGI sold it's part of Cray to a company called Tera which then changed its name to Cray.

  3. Doom by Klar · · Score: 2, Funny

    Wonder if that thing could play Doom3?

  4. That's impressive, but .. by stinkyfingers · · Score: 2, Funny

    Can it run a JVM running on a Windows box and still be able to refresh the graphics?

  5. Doom 3 and 10240 Itanium2 processors by levram2 · · Score: 4, Funny

    I'm guessing that NASA found out Doom 3 has a software renderer and are buying the minimum specs.

  6. Re:Honest question: Why Linux? by WindBourne · · Score: 5, Insightful

    The reason? The License. While BSD License really is the most free, it would allow IBM to put a lot of effort into it, and then have MS swope in, modify it, and sell with a sorts of closed APIs, etc.

    In essence, the BSD license would allow the creation of another Unix model where the core is identical or just similar, but the APIs would be used to lock users in. How would that solve IBM's problem? Or for that matter any Hardware vendors problem? It would not.

    --
    I prefer the "u" in honour as it seems to be missing these days.
  7. Surviving, but stock in a free-fall by Ars-Fartsica · · Score: 3, Interesting
    I commend SGI for finding a way to survive in a brutal post-workstation, post-proprietary-unix world - for a bit there it looked like they were going to be a candidate for an office furniture auction....but the stock is about to enter the penny range. It will be hard for SGI to attract serious capital if they go sideways in a range under $1, and they will once again court delisting.

    Good luck SGI, the Valley is rooting for its former star, and so are a lot of stock speculators.

    1. Re:Surviving, but stock in a free-fall by swb · · Score: 2, Informative

      I'm not a market whiz by any means, but how does a low stock price (assuming other, positive indicators) influence whether a company can survive or not? Once the stock is sold by the company, they don't make any further money on its continued sale.

      A stock whose price continues to climb can allow the company to essentially print money by issuing new stock (if the price climbs fast enough existing shareholders don't generally notice or care that you're diluting the pool), but beyond that, how does share price influence the company's actual operations?

      Going further OT, I think Apple should have bought SGI. They could have gained credibility in the scientific visualation and industrial sectors and had a tidy little OS and GUI that could have spanned from the receptionist desk to the research machine room, in addition to gaining some high-end server solutions far beyond their XServes.

      Somehow it seems that something like this could have develped into a really cool desktop solution that would allow users to run applications locally and remotely on big iron (yes, X-windows style) but with the ease of use and friendliness Apple's known for.

    2. Re:Surviving, but stock in a free-fall by swb · · Score: 2, Informative

      I guess I presume that most "stable" corporations (those out of their high growth phases) don't raise cash that often via increasing their outstanding shares, but instead go through the bond market or other lines of credit (banks or suppliers).

      You can only print stock if your stock value is fast rising, and that's not that many companies. Otherwise it has the same effect as printing money -- devaluing the existing shareholder's shares.

      Regardless, heavy trade in a corporation's stock actually does very little to raise capital for the company.

  8. Big plans at NASA by pixas · · Score: 3, Funny

    So NASA is planning to upgrade to Longhorn then?

  9. This should be enough power... by SunPin · · Score: 3, Funny

    to fake a human settlement on Mars.

    --
    Laws are for people with no friends.
  10. Homo Zapiens by xenostar · · Score: 2, Interesting

    In a wonderful book "Homo Zapiens" by Victor Pelevin, the leaders of the world are rendered on clusters of SGI machines by a secret organization. Makes you wonder when you hear about these clusters :)

  11. Re:Honest question: Why Linux? by mrm677 · · Score: 2, Interesting

    The reason? The License. While BSD License really is the most free, it would allow IBM to put a lot of effort into it, and then have MS swope in, modify it, and sell with a sorts of closed APIs, etc.

    In essence, the BSD license would allow the creation of another Unix model where the core is identical or just similar, but the APIs would be used to lock users in. How would that solve IBM's problem? Or for that matter any Hardware vendors problem? It would not.


    Finally an answer that doesn't involve ranting and raving about GPL/freedom/blah blah blah. Thanks for the simple common-sense answer to this question I wondered myself.

  12. How much did they pay for this thing? by DeathPenguin · · Score: 3, Interesting

    Just curious. My guess is that Intel keeps pumping money into SGI to get Altix systems out and those who have them (LLNL and ...?) got them at practically no charge to run Linpack and look good on the Top500 list.

    1. Re:How much did they pay for this thing? by flaming-opus · · Score: 2, Interesting

      I doubt intel is pumping a lot of cash into sgi, but they may have cut them a real deal on the chips. When I first read about this computer I thought "what a coup for sgi." Then I read the dollar mark and thought "what a coup for nasa." $45million including storage and fibre channel? That's less than $2million per on those 512 proc altix boxes. They're not making much margin on those.

      To counter all of their detractors, Itanium2's are pretty hot processors, and SGI has done an amazing job getting linux to run well on 500 processors. This will no doubt be one hell of a fast machine. I'm just amazed that sgi can stay in business selling at this price.

      If anyone has been watching supercomputers lately, you might have noticed that cray is downsizing by 20% after selling 0 computers in their most recent quarter. It's a tough market for supercomputer makers. The clusters are good-enough-and-cheap. This box is being sold at very little more than cluster cost. Ick.

  13. After it's built.. by stratjakt · · Score: 2, Funny

    It whirs and clicks and sputters..

    Finally, the following cryptic message mysteriously appears on it's console:

    42

    --
    I don't need no instructions to know how to rock!!!!
  14. SGI was supposed to be dead by geomon · · Score: 3, Interesting

    I'm glad to see that SGI has regained its legs and is back in the high-end computing market again. The gamble they made in embracing Linux has paid off. Other folks had counted them dead because they came to the WinNT game late and were, therefore, fated to be high-priced integrators. Their days were numbered by the low-end market forces like Dell and HP.

    Now we see that there is a market for high-priced integrators as long as the underlying technology fits the market segment you target.

    --
    "Rocky Rococo, at your cervix!"
    1. Re:SGI was supposed to be dead by arth1 · · Score: 5, Informative
      I'm glad to see that SGI has regained its legs and is back in the high-end computing market again. The gamble they made in embracing Linux has paid off.

      What few people seem to know (and appreciate) is that SGI has been one of the major contributors to Linux over the last few years. Not only XFS, but lots of commands, utilities and system functions have been enhanced, based on IRIX code. This has been a significant boost to Linux, and it's only fair that SGI reaps some benefits.
      I wish SGI and its employees the best of luck!

      Regards,
      --
      *Art
  15. This could mean the end of civilization... by Saeed+al-Sahaf · · Score: 2, Funny

    Doesn't NASA know that Linux is national security threat??? And 10240 cpu cluster no less? Don't they know that such concentrated evil will create a singularity? This could be the end of our civilization.

    --
    "Who are in control, they are not in control of anything - they don't even control themselves!" - Glen Beck
  16. 10240-Processor Altix Cluster vs IBM Blue Gene? by cdc179 · · Score: 3, Informative

    I have always liked SGI hardware. And congradulations are in order for them to have a single Linux kernel running across 512 CPUs.

    In SGIs press release they state that they hope to get the top spot on the 500 list. As all know IBM is expecting Blue Gene http://www.research.ibm.com/bluegene/ to take the top spot in 2005.

    It looks like SGIs architecture for the Altix is better than the Blue Gene, but 10,240 intel CPUs is just going to be outpowered by the 65,536 PowerPC CPUs in Blue Gene.

    Now the ultimate machine would have SGIs architecute (memory) and #CPUs per node using the PowerPC CPU. We know that IBM and SGI would never colaborate on something like this, but can't a geek dream!

    More blue gene specs: http://sc-2002.org/paperpdfs/pap.pap207.pdf

    1. Re:10240-Processor Altix Cluster vs IBM Blue Gene? by cdc179 · · Score: 2, Informative

      I shouldn't have to expand on the previous stated. One should be able to extrapulate why what was said is so due to common sence and the links that have been posted. None the less, here it goes.

      BlueGene/L:
      From http://www.research.ibm.com/bluegene/BG_External_P resentation_January_2002.pdf pg 9:

      Each node will contain 8 CPUs. There are 128 Nodes per rack and 64 racks. This yields the 65536 total CPUs.

      10,240 Processor SGI Altix: 512 CPUs per node X 20 nodes = 10,240 total CPUs.

      Now that the groundwork has been layed. You can see that the Blue Gene/L only uses 8 CPUs/node while Altix uses 512/node. As you know there is a huge advantage of having more CPUs that share a common bus and have direct access to the memory. Also SGI is well known for having some of the top numbers for memory throughput.

      Therefore one can see that the ultimate HPC Monster would have SGIs architecture as far as bus, memory and #CPUs per node using IBMs PowerPC. Of course this would require a joint effore and wouldn't happen. The only way I could see something like this happen is if IBM bought SGI.

      I didn't go much into details about why the number of CPUs sharing a common bus is such an advantage. But one shouldn't have to. Anybody with any architecture knowledge should get the argument.

  17. Someone at NASA... by TWooster · · Score: 2, Funny

    ... was reading too much Slashdot.

    I knew nothing good could come of all those beowulf cluster ideas!

  18. Re:Is their graphics really ATI? by Bo+Diddly+Squat · · Score: 2, Informative

    The MIPS/IRIX systems have VPro graphics, yes. But those are not from NVIDIA. VPro for MIPS/IRIX is the last chipset to be developed inhouse.

    The confusion comes from the fact that Sgi marketing thought it would be a good idea to give both the PC and Irix graphics cards the same brand: VPro.

    They currently don't have anything newer for their workstations, but their newest Onyx (visualization system) computers use a couple of Ati cards for their graphics. It's called the UltimateVision.

  19. Re:Is their graphics really ATI? by lweinmunson · · Score: 4, Informative

    thought that SGI sold a lot of their graphics IP (including many of their top graphics engineers) to NVIDIA a while back, and still have agreements with them. Their IRIX systems sell with VPRO graphics cards, which I believe are repackaged NVIDIA chips with a few extras..

    Or did I miss something?


    Yes, The Vpro series only resembles Nvidia chipes because after it was completed, most of the team went to work for Nvidia and created the geforce with lots of the same ideas behind it. So the original GeForce chips were more like cut down Vpro's than the VPro's were soupped up GeForces if that makes any sense.

  20. ...well.... by mhore · · Score: 4, Interesting

    I don't know what NASA would do with this, but I know what our group would do with it.

    We always need machines. You could give me 1024 machines and I'd still need more.

    For example, I study fluids currently. I may simulate 4,000,000 particles and it may take 3 weeks for my simulation to finish. If I had 10240 nodes, it may only take a day. Or perhaps I could simulate MORE particles for longer. There are all sorts of advantages to having this many machines hooked up.

    One thing I can tell you for sure is that there most likely will not be *1* job that uses all of these at once. There are probably several researchers that are using it simultaneously and have a slice of the machines. Press releases like this are often time misleading because usually the CPUs are split between several jobs and researchers and research groups and what not.

    Not to steal NASA's thunder -- a cluster this big is impressive.

    Mike.

    --

    Mmmm......sacrelicious.

  21. Re: Great News for Intel by quarkscat · · Score: 2, Informative

    With this cluster, Intel will have doubled
    the number of Itanium 2 sales for the YEAR!

  22. Re:Honest question: Why Linux? by swillden · · Score: 2, Informative

    I would not be surprised if SGI got NASA to agree to not give the source to anybody else (I believe that is legal within the GPL, but IANAL).

    No need to be a lawyer, the GPL is very readable. Section 6 of the GNU GPL (emphasis mine):

    6. Each time you redistribute the Program (or any work based on the Program), the recipient automatically receives a license from the original licensor to copy, distribute or modify the Program subject to these terms and conditions. You may not impose any further restrictions on the recipients' exercise of the rights granted herein. You are not responsible for enforcing compliance by third parties to this License.

    Clear enough?

    --
    Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.