Slashdot Mirror


Inside The World's Most Advanced Computer

Junky191 writes: "Just came across an informational page for the Earth Simulator computer, which provides nice graphics of the layout of the machine and its support structure, as well as details about exactly what types of problems it solves. Fascinating for the engineering problems tackled- how would you organize a 5,120 processor system capable of 40Tflops, and of course don't forget about the 10TB of shared memory." Take note -- donour writes: "well, the new list of supercomputer rankings is up today. I have to say that the Earth Simulator is quite impressive, from both a performance and architectural standpoint."

26 of 270 comments (clear)

  1. Earth Simulator? by Artifice_Eternity · · Score: 5, Funny

    Didn't the mice in H2G2 already build such a computer? I think it was called... the Earth.

    Will the Earth Simulator have the nice fjords by Slartibartfast? :)

  2. I'd like to learn how to code for this beast by Anonymous Coward · · Score: 3, Funny

    So that in 15 years I'll already know how to code for the PlayStation 6.

  3. Hmmm.. by Peridriga · · Score: 4, Funny

    Could you imagine a beouwolf..... Ahh fuck it..

  4. OS'es for the supercomputers... by dnaumov · · Score: 4, Interesting

    I am not going to ask "Does this run Linux ?" because it obviously does not, but can anyone point to some good resources on what kind of Operating Systems do these monster machines run ? Are they some kind of a UNIX ? Or are they some elite breed of OS that mortal humans have no chance of understanding ? Linkage appreciated.

    1. Re:OS'es for the supercomputers... by binaryDigit · · Score: 3, Funny

      The IBM units run AIX, the DEC^H^H^HCompaq^H^H^H^H^H^HHP systems run Tru64 Unix, which I believe is derived (or simply renamed) Ultrix. Don't know what ES runs though, maybe extended mode DOS 6.2?

    2. Re:OS'es for the supercomputers... by mt-biker · · Score: 4, Informative

      These machines tend to be clusters of smaller machines. IBM's SP architecture, for example, runs AIX which doesn't need to scale particularly well.

      The magic in SP is partly hardware (high-speed interconnect between nodes), partly the admin software which allows admin tasks to be run simultaneously of many nodes (a non-negligible task), and is otherwise left up to the application programmers to use MPI or similar to get the application to run over the cluster.

      Single system images typically don't scale this large. Cray's UNICOS/mk (Unix variant) is a microkernel version of the UNICOS OS, used on the T3E and it's predecessors, where a microkernel runs on each node, obviously incurring some overhead, but avoiding bottlenecks that otherwise occur as you scale. Here's some info. Last time I checked, T3E scaled to 2048 processors.

      Out of the box, SGI's IRIX scales very nicely up to 128-256 processors. Beyond that "IRIX XXL" is used (up to 1024 processors, to date). This is no longer considered to be a general purpose OS!

      IRIX replicates kernel text across nodes for speed, and kernel structures are allocated locally wherever possible. But getting write access to global kernel structures (some performance counters, for example) becomes a bottle-neck as the system scales.

      IRIX XXL works around these bottle-necks, presumably sacrificing some features in the process. Sorry, I can't find a good link on IRIX scalability.

    3. Re:OS'es for the supercomputers... by Surak · · Score: 3, Informative

      Nope. As others have pointed out it runs Super-UX, which is a commercial Unix variant all NEC's supercomputers run.

      Anyway, it probably S-UX. :)

  5. Eniac... by chuckw · · Score: 3, Interesting

    What is really amazing is that in 50-60 years, this amount of computing power will easily fit within the confines of the standard PC case (assuming such a thing even exists 50-60 years from now). Remember ENIAC...

    --
    *Condense fact from the vapor of nuance*
  6. the real question is... by doooras · · Score: 4, Funny

    how many FPS does this bitch get in Quake III?

    1. Re:the real question is... by Lars+T. · · Score: 5, Funny

      Does it have a floppy drive?

      --

      Lars T.

      To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

  7. algorithm development by FrenZon · · Score: 3, Interesting

    This is a question, and not a statement

    While this does a nice job of crunching numbers, how do they know that their algorithms are any good at doing what they do? Or are they trying to simulate things that aren't continuously kicked around by chaos theory?

    I ask because I've been looking at dynamics in my spare time, and simulating something as small as cigarette smoke accurately seems impossible (although I must say Jos Stam and Co did a nice job of making it look real). So it seems a bit bewildering to see something trying to simulate the earth, even if only at a macro level.

    1. Re:algorithm development by lowLark · · Score: 5, Informative

      The easiest way to validate these types of prediction mechanisms is to feed them only part of your data set and see how well it predicts your remaining dataset. For example, if you have an ocean temperature data set from 1920 to the present, you might start by feeding it 1920-1992 and seeing how well its predictions for then past ten years hold up to you actual data. You may think that the known data set it too small for accurate predictions, but there are some fascinating methods (like ice core sampling and tree growth sampling) that seem to allow pretty good deductions as to past climate conditions over a very long period of time.

    2. Re:algorithm development by hype7 · · Score: 3, Insightful

      While this does a nice job of crunching numbers, how do they know that their algorithms are any good at doing what they do? Or are they trying to simulate things that aren't continuously kicked around by chaos theory?


      This is an extremely insightful comment.

      What's being suggested here is akin to this - sure, they've got the most powerful car in the world, but to get from LA to New York, you've got to head east. Heading North won't help much, no matter how powerful your car is.

      This is what gets me about all these global warming "earth is going to heat up and cool down and rain and drought and..." predictions. How can they be sure they're even in the ballpark?

      One variable out, they could throw their predictions out by a massive amount. Their simplifications to allow for the computer to do predictions may not take into account the nuances and subtleties of the real world.

      That's why, in many instances, I look at these computers with perhaps more cynicism than most other people. They're great for testing theories, and for allowing scientists to compute algorithms that they possibly otherwise wouldn't be able to do. But just because it's come out of a billion $$$ computer, doesn't mean it's a golden egg.

      It's like that old saying that came out when word processors were first invented - shit in, shit out. Just because it's been through a fancy (or expensive) machine it doesn't make the outcome any more valid.

      -- james
  8. Earthquakes shmirthquakes. by ErikTheRed · · Score: 5, Funny

    They don't want to admit it, but the real reason for building this thing is so that they can predict appearances of Godzilla....

    --

    Help save the critically endangered Blue Iguana
  9. "Advantages" of ES by binaryDigit · · Score: 5, Interesting

    Seems to me that though ES takes the overall performance crown, that the IBM and HP (man that sounds strange) units have some definite advantages over it. Primary of which is the fact that they DO use "off the shelf" parts. ASCI White uses 375Mhz Power3 chips which are comparitively low performance compared to what IBM is shipping now (1.3 Ghz Power4). I don't know what the technical details are behind ASCI White, but it seems that IBM could instantly get a doubling of performance by using new CPU modules. With the "specialized processor" approach that NEC uses, this would seem to be prohibitively expensive. IBM has already amortized most of the cost of the development of new processors through their normal business units.

    Another advantage would be that since ASCI White is a hyper RS6K, you could use a lower end model (and IBM could rather inexpensively offer a lower end model) to develop your models on before using the relatively expensive big boy to do the actual simulations. I have to admit that this point is moot if they don't keep the utilization of the thing up pretty high most of the time.

    Though they mention that ES "only needs 5104" processors vs 8192 for AW, it looks like ES still takes up massive amounts of space. Now ES' storage is significantly larger that AW, so maybe that's where all the space is being eaten, but it would be interesting to see what the actual cabinet space/power requirements for the two machines sans storage are (assuming they are both using standard stuff for storage).

    Others things include since AW is based on OTS parts, is it easier to get parts for when processing units konk out. Is it simpler for a tech to work on the unit. Since Linux is already running on RS6K, theoretically with a few device drivers, you could run Linux on that bad boy

    Of course all this is moot in the non-real-world of supercomputers. With seemingly infinite budgets, the only _real_ measure is absolute performance, and ES obviously has the edge here. But if I were the IBM sales rep for supercomputing, I'd sure be hyping the fact that when it's not simulating nuclear explosions, you can run Gimp and Mozilla.

    1. Re:"Advantages" of ES by alfadir · · Score: 3, Informative

      You can get an SX-6i . The processor in ES is not made only for ES. And I don't think you would sell many supercomputers for IBM if you were advocating Gimp and Mozilla as applications...

    2. Re:"Advantages" of ES by peatbakke · · Score: 4, Informative

      I'm not sure how much you've looked up, so some of this information may be redundant, but here's what I've been able to dig up:

      • The Power4 chip has two processor cores and a shared 1.44MB on-chip L2 cache .. which in turn appears to be implemented as three separate cache controllers. The cache lines are hashed across the controllers, which is a pretty neat trick IMHO.
      • It weighs in at about 170 million transistors
      • This PDF mentions that there are over 5500 total I/Os (including > 2200 signal I/Os) that give the chip a raw bandwidth of over 1 Tb/s.
      • According to this page, the chip simulations show the core temperature peaking around 82C (~180F) in certain regions of the chip, and consuming 115 - 140 watts.

      That's a beast of a chip! The packaging looks pretty substantial as well. I don't doubt the cooling systems are fairly remarkable, although I can't find any specific information about 'em.

      cheers!

  10. Can you imagine... by bakes · · Score: 5, Funny

    ..a single-cpu one of these!!!

    --
    Ho! Haha! Guard! Turn! Parry! Dodge! Spin! Ha! Thrust!
  11. "I predict by zephc · · Score: 3, Funny

    that within 100 years computers will be twice as powerful, 10,000 times larger, and so expensive that only the five richest kings of Europe will own them." - Prof. Frink

    --
    "I would say that 99 per cent of what my father has written about his own life is false." - L. Ron Hubbard Jr.
  12. Earth Simulator OS + German TV by alfadir · · Score: 5, Informative

    The Earth Simulator is running Super UX. The same operating system as the rest of the NEC supercomputers

    The German Language TV channel 3sat will broadcast a 30 min film on Earth Simulator on Monday and 24th of June at 21:30 hours and on Tuesday, 25th of June at 14:30 hours.

  13. Re:Unfortunately... by Ralph+Bearpark · · Score: 3, Funny
    The Earth simulator will be destroyed to make way for a hyperspacial bypass...

    Well, it would be kinda ironic if it got knocked out by an earthquake. Especially if it didn't predict it.

    Regards, Ralph.

  14. Re:Apples and Oranges by Jeremy+Erwin · · Score: 3, Interesting

    Specialization? What specialization? The Top500 rankings are based on LinPack-- a software package for solving dense systems of linear equations-- which seems applicable to a fairly general set of scientific problems.

    Do supercomputing manufacturers cheat on benchmarks? I don't know. Presumably it would be a rather expensive proposition-- and since supercomputing sites will benchmark with a variety of specialized and general purpose libraries, it seems unlikely to work.

    There, are, of course, differences between weather simulations and galactic evolution simulations. But field specific benchmarks are inappropriate for a site like Top500--the whole point of the site is to allow someone to analyse gross trends. "This memory architecture once dominated the rankings--now its used by only a few entries. Perhaps our next computer platform shouldn't be based on that architecture." (and possibly writing journal articles about it.)

    In addition, general purpose supercomputing sites are relatively common.

  15. stupid reference right below this.... by DanThe1Man · · Score: 3, Funny

    The Earth Simulator Project will create a "virtual earth" on a supercomputer...

    Hmmm, now where have I heard of an idea like that?

  16. "Inside" the Earth Simulator by erlando · · Score: 4, Interesting

    There are some nice pictures on the ES site as well. I wonder if the colouration of the cabinets is there to prevent the engineers from getting lost..? :o)

    --
    Remember, there are no stupid questions. But there are a lot of inquisitive idiots.
  17. Re:Not a Beowulf cluster comment, but... by sacremon · · Score: 4, Interesting

    Better rethink that theory:

    Earth Simulator: 35.86TFlops.sec (according to Top100 list)

    Seti@Home network: 37.07TFlops/sec (over last 24hr., according to the site).

    Just because it is an incredibly powerful machine doesn't mean it has the distributed computing projects beat.

    --
    If you can't beat them, embrace and extend them.
  18. What they are really trying to do... by FearUncertaintyDoubt · · Score: 3, Funny

    ...is build a computer capable of withstanding a full slashdotting.