Slashdot Mirror


Inside The World's Most Advanced Computer

Junky191 writes: "Just came across an informational page for the Earth Simulator computer, which provides nice graphics of the layout of the machine and its support structure, as well as details about exactly what types of problems it solves. Fascinating for the engineering problems tackled- how would you organize a 5,120 processor system capable of 40Tflops, and of course don't forget about the 10TB of shared memory." Take note -- donour writes: "well, the new list of supercomputer rankings is up today. I have to say that the Earth Simulator is quite impressive, from both a performance and architectural standpoint."

14 of 270 comments (clear)

  1. Earth Simulator? by Artifice_Eternity · · Score: 5, Funny

    Didn't the mice in H2G2 already build such a computer? I think it was called... the Earth.

    Will the Earth Simulator have the nice fjords by Slartibartfast? :)

  2. Hmmm.. by Peridriga · · Score: 4, Funny

    Could you imagine a beouwolf..... Ahh fuck it..

  3. OS'es for the supercomputers... by dnaumov · · Score: 4, Interesting

    I am not going to ask "Does this run Linux ?" because it obviously does not, but can anyone point to some good resources on what kind of Operating Systems do these monster machines run ? Are they some kind of a UNIX ? Or are they some elite breed of OS that mortal humans have no chance of understanding ? Linkage appreciated.

    1. Re:OS'es for the supercomputers... by mt-biker · · Score: 4, Informative

      These machines tend to be clusters of smaller machines. IBM's SP architecture, for example, runs AIX which doesn't need to scale particularly well.

      The magic in SP is partly hardware (high-speed interconnect between nodes), partly the admin software which allows admin tasks to be run simultaneously of many nodes (a non-negligible task), and is otherwise left up to the application programmers to use MPI or similar to get the application to run over the cluster.

      Single system images typically don't scale this large. Cray's UNICOS/mk (Unix variant) is a microkernel version of the UNICOS OS, used on the T3E and it's predecessors, where a microkernel runs on each node, obviously incurring some overhead, but avoiding bottlenecks that otherwise occur as you scale. Here's some info. Last time I checked, T3E scaled to 2048 processors.

      Out of the box, SGI's IRIX scales very nicely up to 128-256 processors. Beyond that "IRIX XXL" is used (up to 1024 processors, to date). This is no longer considered to be a general purpose OS!

      IRIX replicates kernel text across nodes for speed, and kernel structures are allocated locally wherever possible. But getting write access to global kernel structures (some performance counters, for example) becomes a bottle-neck as the system scales.

      IRIX XXL works around these bottle-necks, presumably sacrificing some features in the process. Sorry, I can't find a good link on IRIX scalability.

  4. the real question is... by doooras · · Score: 4, Funny

    how many FPS does this bitch get in Quake III?

    1. Re:the real question is... by Lars+T. · · Score: 5, Funny

      Does it have a floppy drive?

      --

      Lars T.

      To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

  5. Earthquakes shmirthquakes. by ErikTheRed · · Score: 5, Funny

    They don't want to admit it, but the real reason for building this thing is so that they can predict appearances of Godzilla....

    --

    Help save the critically endangered Blue Iguana
  6. "Advantages" of ES by binaryDigit · · Score: 5, Interesting

    Seems to me that though ES takes the overall performance crown, that the IBM and HP (man that sounds strange) units have some definite advantages over it. Primary of which is the fact that they DO use "off the shelf" parts. ASCI White uses 375Mhz Power3 chips which are comparitively low performance compared to what IBM is shipping now (1.3 Ghz Power4). I don't know what the technical details are behind ASCI White, but it seems that IBM could instantly get a doubling of performance by using new CPU modules. With the "specialized processor" approach that NEC uses, this would seem to be prohibitively expensive. IBM has already amortized most of the cost of the development of new processors through their normal business units.

    Another advantage would be that since ASCI White is a hyper RS6K, you could use a lower end model (and IBM could rather inexpensively offer a lower end model) to develop your models on before using the relatively expensive big boy to do the actual simulations. I have to admit that this point is moot if they don't keep the utilization of the thing up pretty high most of the time.

    Though they mention that ES "only needs 5104" processors vs 8192 for AW, it looks like ES still takes up massive amounts of space. Now ES' storage is significantly larger that AW, so maybe that's where all the space is being eaten, but it would be interesting to see what the actual cabinet space/power requirements for the two machines sans storage are (assuming they are both using standard stuff for storage).

    Others things include since AW is based on OTS parts, is it easier to get parts for when processing units konk out. Is it simpler for a tech to work on the unit. Since Linux is already running on RS6K, theoretically with a few device drivers, you could run Linux on that bad boy

    Of course all this is moot in the non-real-world of supercomputers. With seemingly infinite budgets, the only _real_ measure is absolute performance, and ES obviously has the edge here. But if I were the IBM sales rep for supercomputing, I'd sure be hyping the fact that when it's not simulating nuclear explosions, you can run Gimp and Mozilla.

    1. Re:"Advantages" of ES by peatbakke · · Score: 4, Informative

      I'm not sure how much you've looked up, so some of this information may be redundant, but here's what I've been able to dig up:

      • The Power4 chip has two processor cores and a shared 1.44MB on-chip L2 cache .. which in turn appears to be implemented as three separate cache controllers. The cache lines are hashed across the controllers, which is a pretty neat trick IMHO.
      • It weighs in at about 170 million transistors
      • This PDF mentions that there are over 5500 total I/Os (including > 2200 signal I/Os) that give the chip a raw bandwidth of over 1 Tb/s.
      • According to this page, the chip simulations show the core temperature peaking around 82C (~180F) in certain regions of the chip, and consuming 115 - 140 watts.

      That's a beast of a chip! The packaging looks pretty substantial as well. I don't doubt the cooling systems are fairly remarkable, although I can't find any specific information about 'em.

      cheers!

  7. Can you imagine... by bakes · · Score: 5, Funny

    ..a single-cpu one of these!!!

    --
    Ho! Haha! Guard! Turn! Parry! Dodge! Spin! Ha! Thrust!
  8. Re:algorithm development by lowLark · · Score: 5, Informative

    The easiest way to validate these types of prediction mechanisms is to feed them only part of your data set and see how well it predicts your remaining dataset. For example, if you have an ocean temperature data set from 1920 to the present, you might start by feeding it 1920-1992 and seeing how well its predictions for then past ten years hold up to you actual data. You may think that the known data set it too small for accurate predictions, but there are some fascinating methods (like ice core sampling and tree growth sampling) that seem to allow pretty good deductions as to past climate conditions over a very long period of time.

  9. Earth Simulator OS + German TV by alfadir · · Score: 5, Informative

    The Earth Simulator is running Super UX. The same operating system as the rest of the NEC supercomputers

    The German Language TV channel 3sat will broadcast a 30 min film on Earth Simulator on Monday and 24th of June at 21:30 hours and on Tuesday, 25th of June at 14:30 hours.

  10. "Inside" the Earth Simulator by erlando · · Score: 4, Interesting

    There are some nice pictures on the ES site as well. I wonder if the colouration of the cabinets is there to prevent the engineers from getting lost..? :o)

    --
    Remember, there are no stupid questions. But there are a lot of inquisitive idiots.
  11. Re:Not a Beowulf cluster comment, but... by sacremon · · Score: 4, Interesting

    Better rethink that theory:

    Earth Simulator: 35.86TFlops.sec (according to Top100 list)

    Seti@Home network: 37.07TFlops/sec (over last 24hr., according to the site).

    Just because it is an incredibly powerful machine doesn't mean it has the distributed computing projects beat.

    --
    If you can't beat them, embrace and extend them.