Slashdot Mirror


Linux Chosen for IBM's New Supercomputer

Uhh_Duh writes "news.com is reporting that Linux will be the main OS in the Blue Gene - IBM's $100m supercomputer project. The Blue Gene will contain 65,000 processors and 16 trillion bytes of memory." Wow. That's a lot of nuclear weapons simulations.

36 of 337 comments (clear)

  1. Re:What distribution? by Anonymous Coward · · Score: 5, Funny

    It'll be Redhat, 6 point something. They found a set of the CDs lying around so they decided to use that.

  2. Re:What distribution? by stevelinton · · Score: 5, Informative
    I think we can safely assume it will be their own very special system. The article says:

    Tailoring Linux to run on these upcoming machines will require substantial research, according to IBM. The company has, for instance, created a technique where only select processors can access the full hardware resources of the machines. IBM is also looking at ways to reduce interference between different tasks.


    Hopefully the fruits of this will feed through into the mainline kernel and so to other systems.
  3. Gzzzzap by Overand · · Score: 4, Funny

    In other news, the oil companies rejoyce as they plan the new power plant that this number of processors will require.

  4. Why Linux? by Kj0n · · Score: 5, Funny

    It seems to be the ideal system to run the next Microsoft operating system.

    To quote someone else: "16 trillion bytes should be enough for everyone."

  5. Not nukes by Plutor · · Score: 4, Insightful

    That's a lot of nuclear weapons simulations.

    RTFA. That's a lot of protein fold simulations.

    1. Re:Not nukes by spoonyfork · · Score: 4, Informative

      I read the f'ing article and it says...

      Blue Gene/L, the first member of the family, will contain 65,000 processors and 16 trillion bytes of memory. Due in 2004 or 2005, the system will be able to perform 200 trillion calculations per second. Lawrence Livermore National Laboratory will use the system for performing nuclear weapons simulations.

      Unless nuclear weapons simulations is secret code for protien fold simulations, then I don't get it.

      --
      Speak truth to power.
    2. Re:Not nukes by DJPenguin · · Score: 4, Funny

      Last I checked, Nuclear weapons did a pretty good job of folding MY proteins! ouch!

  6. Imagine a Beowulf cluster of these! by nmg196 · · Score: 4, Funny

    What's the official benchmark of this thing, on a well known scale like QFPS (Quake Frames Per Second)...? :)

  7. In other news... by vinlud · · Score: 4, Funny

    ... id Software finally found a proper testing environment for Doom 3!

    --
    Repeat after me: We are all individuals
  8. Deep Thought? by srhuston · · Score: 5, Funny
    I love this line in the story:
    The IBM research team is currently running a large Linux cluster to simulate Blue Gene.

    Building a computer, to tell you how to build another, larger, more complex computer. Hrmmm..
    --
    Three dits, four dits, two dits, dah!
    Radio, radio, rah rah rah!
    1. Re:Deep Thought? by blancolioni · · Score: 4, Informative

      Building a computer, to tell you how to build another, larger, more complex computer. Hrmmm..

      Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?

    2. Re:Deep Thought? by io333 · · Score: 5, Funny

      Building a computer, to tell you how to build another, larger, more complex computer. Hrmmm..

      Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?

      Naturally I laid out my own CPU by hand. I run Gentoo on it too. We all do. What are you, some kind of Mandrake wussy?

    3. Re:Deep Thought? by N+Monkey · · Score: 5, Interesting

      Building a computer, to tell you how to build another, larger, more complex computer. Hrmmm..

      Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?


      Continuing on that theme, it's written (at least next to the Apple 1 and Cray machines at the Science Museum in London) that Seymour Cray used an Apple to design his super computers while Apple used a Cray to simulate one of their designs.

  9. Lots more info by stevelinton · · Score: 5, Informative

    There's A nice presentation[ibm.com] that describes the system quite well.

  10. Re:The end of AIX by Multics · · Score: 5, Insightful
    First, this is not news. Linux has been the O/S of choice for the BlueGene family of computers since the beginning.

    Second, the AIX roadmap goes out to at least 2007 (five year planning window). So don't be throwing away your SMIT knowledge quite yet. I'd be very surprised if there wasn't significant AIX work being done as far out as 2010.

    IBM has at least us$20B in AIX and as a result it is very mature. They're putting nearly us$1B a year into Linux (JFS being just one wonderful thing ported). It will still be a while before they can bet the company on Linux. Do also keep in mind that AIX has at least a 15 year head start on Linux.

    -- Multics

  11. Sounds impressive by Rubbersoul · · Score: 5, Funny

    The Blue Gene will contain 65,000 processors

    But what they don't tell you it that it is 65,000 old 386DXs ... :)

    --
    man .sig
    No manual entry for .sig.
  12. Open source IBM by Sacarino · · Score: 5, Interesting

    Anyone else notice this?

    The decision to adopt Linux came, in part, as a result of the growing size and strength of the open-source community. Thousands of developers around the world are participating in the evolution of Linux. Creating a new OS inside of IBM would require a massive engineering effort.

    followed by

    We chose Linux because it's open and....saw considerable advantage in using an operating system supported by the open-source community, so that we can get their input and feedback."

    So, basically, IBM doesn't want to design their own proprietary system (smart) and plans to use the resources currently available. (also smart)

    They want open-source to get them rich, right? Less initial cost by the company, etc etc. What are the odds they'll profit-share with people they're getting rich off of? (well, ok, attempting)

    --
    -- El Sacarino tiene gusto de la chocha
    1. Re:Open source IBM by larien · · Score: 5, Informative

      While they probably won't profit share, they'll likely share in other ways, by code improvements etc. IBM is investing heavily in linux and I'd assume they're looking at ways to improve linux to make it as stable as AIX is. They've already done work on integrating JFS into the kernel, for instance.

    2. Re:Open source IBM by gosand · · Score: 5, Funny
      They want open-source to get them rich, right? Less initial cost by the company, etc etc. What are the odds they'll profit-share with people they're getting rich off of? (well, ok, attempting)

      Dude, why are you bitching? I am sure they will make the source available so you can install it on your own 65,000 processor machine.

      --

      My beliefs do not require that you agree with them.

  13. Re:contributions to OSS? by xtremex · · Score: 4, Informative

    They contribute plenty..one I use and thank them for is JFS, the journalling filesystem used by AIX. I have a question...I love Linux..use it everyday, but I ALSO love AIX..which I think is the superior commercial UNIX..what's wrong with using AIX?

    --
    If you're not a Liberal in your 20's, then you have no heart.If you're still a Liberal in your 30's you have no brain.
  14. Re:Face it. by Iamthefallen · · Score: 5, Funny

    You mean IBM, a large multinational company, isn't just out to do good? They actually use the best tools out there to make a profit without considering their moral obligation to stubbornly pick an OS and stick with it in religious conviction? Oh the horror! Won't someone please think of the children!

    -1, Sarcastic asshole, I know I know...

    --
    Wax-Museum Fire Results In Hundreds Of New Danny DeVito Statues
  15. Re:The end of AIX by rseuhs · · Score: 5, Interesting
    All comercial Unices except Solaris are being replaced by Linux, not just AIX.

    In 5 years, there will be only Linux, BSD and Solaris - with BSD and Solaris being binary and source compatible to Linux.

    Linux has reunited Unix, this is a good thing because it didn't happen by monopilzation from one company. There is lot of diversity within Linux (lots of different vendors and supporters) but it's all compatible.

  16. Re:That's a lot of Tuxes... by machine+of+god · · Score: 5, Funny

    That's why nothing will get done for the first month. The entire development team will be spending sleepless nights porting quake to work with 65000 processors.

  17. Variations on the same story by randomErr · · Score: 5, Informative

    Yahoo! News Version
    IBM Chooses Linux for 'Blue Gene' Supercomputer

    IBM has chosen the open source Linux operating system to run on one of its largest, most powerful supercomputing projects, dubbed "Blue Gene."

    The petaflop computer, which can calculate 1 quadrillion operations per second, is 100 times more powerful than the fastest computers available, according to IBM.

    ZDNet UK
    Linux will power IBM supercomputer project
    The upcoming family of 'Blue Gene' supercomputers will run on an extended form of Linux, a major endorsement for the open source operating system

    Linux will be the main operating system for IBM's upcoming family of "Blue Gene" supercomputers -- a major endorsement for the operating system and the open-source computing model it represents.

    OS Opinion
    IBM Chooses Linux for 'Blue Gene' Supercomputer
    Another supercomputer in the same family, Blue Gene/L, is also set to run Linux. IBM has said Blue Gene/L will be at least 15 times faster than today's fastest supercomputers.
    See Complete Story

    The Blue Gene project, first announced in late 1999, was designed to model the folding of human proteins, allowing researchers to better understand diseases and their cures. At the time, IBM said Blue Gene would be 1,000 times more powerful than "Deep Blue," the computer that beat chess champion Garry Kasparov in 1997.

    --
    You say things that offend me and I can deal with it. Can you?
  18. Unreal 2002 by thomas.galvin · · Score: 4, Funny

    And it still won't render more than 100 FPS on Unreal Tournament. Ah well...

  19. Re:contributions to OSS? by sultanoslack · · Score: 5, Insightful
    Yes, quite regularly in fact. There are a few major ways that this happens:

    Porting or developing their own projects -- JFS is an often pointed to as an example

    Sponsoring developers of Open Source projects -- I know at least one KDE developer that was paid to write a series of tutorials on KParts that were published on IBM's web site . I recently saw something by the founder of Gentoo Linux as well.

    Public Relations -- This is the big one. IBM lends Open Source and Linux more credability than any other company. They throw more resources into promoting Linu x than any other company. At a time where most major tech companies are at the most passively supporting Linux, IBM is very actively promoting it, and it's the reason that a lot of other major players are paying attention to Linux

    Again, you can't underestimate the effects that having IBM backing Linux has in a corporate environment. Intel and AMD are paying attention because of IBM, and I'd be that a lot of a big part of why MS has taken note of Linux lately is that competing with Linux means competing with IBM.

    So yes, they're contributing back, but the most significant ways are not the conventional methods. They're in fact contributing something to Linux that no number of hackers can -- credibility.

  20. Re:Face it. by rseuhs · · Score: 5, Insightful
    Yeah, face it: They understood basic market mechanisms, while you don't.

    Linux is free. Linux will remain free. Forever.

    And "free" as in "freedom" is important. It guarantees a save investment and makes sure you are not trapped in vendor lock-in. It also guarantees the abcense of stuff like WPA or MSFT's new EULA.

    Stuff like that is more important than what "sucks" and what has "media appeal". IBM has learned this first-hand with OS/2.

    No, OS/2 did not fail because of crappy marketing. It failed because computer-makers refused to preinstall a OS from a competitor. No matter how cheap it might have been, no matter how great it was. - It would have been a stupid decision for computer makers to chain themselves to a competitor.

    While some people still don't get it, EVERY major IT-company already understood that Linux is the only way to go long-term. Every major IT-company which is not trapped in Microsoft-contracts is supporting, using and/or offering Linux solutions. IBM, Intel, AMD, Sun, Oracle.. you name it.

  21. Re:The end of AIX by Anonymous Coward · · Score: 5, Insightful

    What????

    IBM have spent a fortune on raising the public profile of linux. Now, perhaps you're a software geek, but those positive articles about linux in the mainstream press don't come cheap. And those IBM Consultants selling linux to conservative financial data centres need a LOT of backing.

    IBM are fighting a propaganda war with Microsoft. That eats millions very fast.

  22. Coming soon: your own 32-way computer on a chip by forged · · Score: 4, Informative
    Actually, the original article has pretty good insights:

    • Blue Gene will use 32 CPUs in a single chip, Goyal said. [...] These chips will contain the computer memory as well [...] A total of 64 of those 32-CPU chips will be packaged in a computing node; then eight nodes will be stacked in each rack. Building 64 of these racks will get IBM to its goal.

    I still hope they get decent coolers 'cuz we're now talking about 32 processors per chip ! Still, what an awesome design to increase the density & number of processors. I was wondering how they'd do it for 65,000. Now I know :)

    Interesting question unfolding : will we ever get those chips on the desktop ? Imagine your own 32-way PC at home. Heh, who needs Beowulf clusters now !

    1. Re:Coming soon: your own 32-way computer on a chip by perky · · Score: 4, Interesting

      errr. I thought this beast had ~65k processors?

      32*64*8*64 = 1048576.

      --
      "The new wave is not value-added; it's garbage-subtracted" - Esther Dyson, Dec 1994
    2. Re:Coming soon: your own 32-way computer on a chip by forged · · Score: 4, Interesting
      There is a lot of confusion reported in the articles, probably fueled by the fact that there are or will be soon 2, 4 and even 32 processors per chip.

      The unedited copy/paste from the article goes like this:

      • The computer will use a new architecture that has more than a million CPUs connected in ever-larger bunches, said Ambuj Goyal, vice president of computer science at IBM Research.

        The chip itself will extend an IBM design philosophy that will emerge in coming years with IBM's Power4 processor. That processor will package four CPUs on a single chip, IBM has said.

        Blue Gene will use 32 CPUs in a single chip, Goyal said.

      So, is that a one-million processors machine they're really building, a 32768 chips machine or what ? ZDnet reporters are on crack today :)

      I wish someone found an article from IBM's PR site with more details and less confusion.

    3. Re:Coming soon: your own 32-way computer on a chip by joib · · Score: 4, Interesting

      The one with ~1 million cpu:s is the final Blue Gene. The one which this article talks about with 65000 cpu:s is Blue Gene/L, which is supposed to be a prototype of the final design.

  23. Old times... by Julius+X · · Score: 5, Funny

    The Blue Gene will contain 65,000 processors and 16 trillion bytes of memory.

    That's a LOT of processors.

    It's nice to see that some companies have kept the tradition of computers that fill a room or five. Maybe they can throw some vacuum tubes on for old time's sake.

    --

    -Julius X
    remove "-whatkindofspamdoyoutakemefor-" from email to send
  24. Re:What distribution? by PurpleFloyd · · Score: 4, Insightful
    Hopefully the fruits of this will feed through into the mainline kernel and so to other systems.
    Seriously, do you think that a version of Linux optimized for 65 thousand processors and ~16 terabytes of RAM will run well on your 2-way SMP box? While this will probably be of help to the supercomputing world (if IBM decide to open source it; remember that they're under no obligation to do so if the binaries don't go out into the wild), it probably won't result in much more performance being squeezed out of a 2 or 4-way Xeon setup, with a relatively tiny gigabyte of RAM.

    Programmers on this level face entirely different challenges, such as optimizing a 65 thousand thread program so that CPUs aren't idle 90% of the time waiting for others. This is going to output some high quality specialized kernel code that about 10 or 20 computers around the world would find helpful performance-wise. Any desktop or server for mere mortals won't see much improvement.

    --

    That's it. I'm no longer part of Team Sanity.
  25. supercomputer crippled by small memory by peter303 · · Score: 5, Informative

    Conventional wisdom, sometimes called Amdahl's second law of computing, says you need as many bytes as flops, i.e. a one second main memory buffer. This computer only has 1/60 sufficient memory- 16 terabytes for one petaflop. Anything that involves serious dataprocessing, e.g. sensor signals, won't run at top speed due to the seriousmemory deficiency.

  26. Re:Face it. by Chanc_Gorkon · · Score: 4, Interesting

    YEAH! :P Heh heh. I admin AIX and it is the best UNIX I have ever worked with. You can do everything from the command line, thru smit, or for the really bad off WSM. SMIT, while it's a CURSES based (Does IBM use NCURSES??) admin tool, you can do almost everything from it. Because you usually buy hardware from IBM, everything just works, or you have diagnostic info to tell you it isn't working including LED codes that tell you why you won't boot (Corrupted BLV, JFS Volume, Bad superblocks....it's all there). In any case, AIX is here to stay and just because IBM chooses to use Linux on their super computer means nothing. It may mean that the government wanted Linux because with THAT many nodes, your AIX support bill would be outrageous! :) That and it maybe the Beowulf stuff just works better then the AIX SP stuff. I wonder if this is using the new Power4 blade servers?

    --

    Gorkman