Slashdot Mirror


Supercomputers To Move To Specialization?

lucasw writes "The Japan Earth Simulator outperformed a computer at Los Alamos (previously the world's fastest) by a factor of three while using fewer, more specialized processors and advanced interconnect technology. This spawned multiple government reports that many suspected would ask for more funding in the U.S. for custom supercomputer architectures and less emphasis on clustering commodity hardware. One report released yesterday suggests a balanced approach."

11 of 174 comments (clear)

  1. Cost comparison? by Tyrdium · · Score: 4, Interesting

    Ignoring size, how does the cost of a cluster of fewer, highly specialized computers (with special interconnects, etc.) compare with that of a cluster of more, less specialized computers?

  2. performance vs cost by harmless_mammal · · Score: 4, Interesting

    Teraflops per dollar is important, let's not forget that.

  3. Someone who's knowledge please tell me by Raul654 · · Score: 3, Interesting

    The Japan Earth Simulator outperformed a computer at Los Alamos (previously the world's fastest) by a factor of three while using fewer, more specialized processors...
    What is the difference between processor designed to simulate earthquakes (et al) and an ordinary, off-the-shelf processor? I mean - so they optomized floating point operations. Is that it?

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
    1. Re:Someone who's knowledge please tell me by QuantumRiff · · Score: 3, Interesting
      Generic processors are ineffecient. Imagine having the fastest processesor on earth, and then take that chip and use it to do the calculation of x1++ (thats x1 = x1 +1 for you non-C'ers)and looping it a few Trillion times. Then take a processor that is desinged specifically to do x1++, and only that calculation. You can run a hell of alot faster, you don't need to worry about having to multiply, devide, etc.. they're smaller, and cooler, and after the cost of engineering them, cheaper.

      Can't remember the link, but somebody made a board with a few FPGA chips (I think) that cracked a 56bit DES key in a few days or less, and distributed.net had how many computers working on it for how many years?

      Its all about designing the chip for the application. The ones they are refferring to would probably be designed to do mass computation of heavy physics, and only be able to run custom Nuke Simulation software.

      The thing I am interested in, as an Ex Computer Systems Engineering major, is are they interested in designing and fabbing processors from the ground up, or using an assload of FPGA's or something from a company like Altera and program them..

      --

      What are we going to do tonight Brain?
  4. Specialization by bersl2 · · Score: 4, Interesting

    If you're going to have a supercomputer do one thing, of course specialize it. An Earth simulation surely has a set number of formulae whose calculations are to be optimized as much as possible, even to the hardware level.

    But if you want a versitile, general-purpose supercomputer, why not go with the clustering solution?

  5. This greatly surprises me by ikewillis · · Score: 4, Interesting
    As an employee of an atmospheric modelling group I am very surprised to hear this. Our atmospheric modelling program, the Regional Atmospheric Modelling System, is not I/O bound in the slightest and is instead very much CPU bound. We currently use 100bT for the interconnect on our cluster, and have tried moving to Gigabit with negligable performance gains.

    The main area in which we saw benefit was switching from the Portland Group Fortran Compiler to the Intel Fortran Compiler, which cut the timestep (simulation time/real time) nearly in half.

    Every cluster in the department is assembled from commodity x86 components. Groups here have been moving from proprietary Unix architectures to Linux/x86 systems and clusters. Our group started out on RS/6000s, then moved to SPARC, and is now moving to x86. In terms of price/performance there really is no comparison.

    As for TCO, the lifetimes of clusters here are relatively short, one or two years at the most. Thus a high initial outlay cannot be set by lower cost of operation.

    1. Re:This greatly surprises me by bathmatt · · Score: 3, Interesting

      I also work in the geophysical modeling arena and you will find that one of the biggest differences in using a purpose build S/C versus a lot of OTS equipment is memory speed. It is typical to reach only 10% of peek efficiency when running an application, even with nice structured problems like you are running. While you claim that you are CPU bound, you really are not. For example, if you run on a slower CPU but with a better memory subsystem or a larger cache (example SGI vs intel/linux) you will find that the SGI will win even though it is a much slower machine on paper. This is because the memory thruput and large cache. Now, to explain why you don't notice the speed up when you went from a 100-1G network, that is because your latency did not change much in that. You are typically sending lots of small packets (assuming you are not doing variable packing and the only atm model I know doing this is WRF) you are never really getting out of the latency mode and not seeing much improvement on the communicatoin speed. This is why people use myrinet (SP) because this can be accessed from the application, not going through the kernel and start transfer much quicker. (For typical latency/bandwidth numbers for a structured grid halo exchange google wallcraft halo and you will get numbers for all different types of machines and code to test yours)

    2. Re:This greatly surprises me by FullyIonized · · Score: 5, Interesting
      And I'm surprised to hear that you are surprised since fluid modeling is one of the applications that do very well with the vector processors that the Earth Simulator uses. I attended a lecture by Dr. Sato, head of the Earth Simulator, who stated that the best application usage was 65% peak usage (the theoretical peak which assumes that the processor always has data to crunch and no branches) and the average was 30% of theoretical peak. By contrast, typical fluid-like codes on current U.S. machines typically get less than 10% of peak usage if they have any type of implicitness (currently the magnetohydrodynamics code I use gives about 6% usage on an IBM SP that is #5 on the Top 500 supercomputer list).

      I get tired of seeing figures that compare peak flop rates and then don't mention that actually code usage isn't keeping up at all. The Japanese (and Europeans who are allowed to buy NEC machines) are absolutely spanking the US when it comes to fluid codes (for climate modeling for example) and it is largely because they are using vector machines with their old highly optimized Fortran (or High Performance Fortran) codes. The MPP revolution in the U.S. has been manna for the CompSci community, but has set the computational physics community back by 10 years (except for those lucky bastards with embarrassingly parallel jobs).

      I would give up an unnecessary body part for an Earth Simulator.

      --
      Sigs are bad for you.
  6. Why oh why? by tomstdenis · · Score: 3, Interesting

    Definitely a really huge super-computer would be neat to have but honestly are they putting the ones we already have to good use?

    From what I've heard [anecdotally] computers like the earth simulator go vastly under utilized for the most part.

    So given that most nations [including the US] have budget problems specially concerning education couldn't people think of better uses for money?

    And before anyone throws a "it's the technology of it" argument my way, I'd like to add that if anything I'd rather have the money spent on researching how to make high performance low power processors [and memory/etc] instead. E.g. an Athlon XP 2Ghz that runs at 15W would be wicked more impressive than a 50,000 processor super computer that runs a highly efficient idle loop 99% of the time.

    Tom

    --
    Someday, I'll have a real sig.
  7. Re:The motivation is a tad depressing by Pharmboy · · Score: 4, Interesting

    It took Sputnik to kickstart our spacemindedness; I for one consider it sad that a "tremendous amount of interest" -- and the funding that comes with it -- in high-performance computing seems only to have arisen/regenerated with the influence of competitive international politics. Are we really so hardly advanced that our respective national egos are still the driving force behind enthusiasm, financial or otherwise, in certain areas of science?

    I don't really see that as bad. Yes, it may look like pure ego, but the space race gave us so much that filtered into the commercial/private sector. From advanced computers to Velcro(tm). From my perspective, being the most advanced nation in as many areas as possible is a good defense, both economically and in a homeland security sense.

    Frankly, I don't want the fastest computer chips on the desktop to be designed by a company in another country (even if Intel makes them outside of the US) and I would rather that the cutting edge, be cut here, in my native country. I am sure other people in other countries feel the same, that pushed all of us to new heights. In the end, the technologies are shared anyway. Most anyone in the world can buy Intel chips, for example.

    If no one cared who could race a bicycle the fastest, Lance Armstrong would be just some guy who had cancer. Instead, our desire to compete and excell and outdo our neighbors has benefited EVERYONE a great deal. It can bring out the bad side from time to time, but the benefits far outweigh the costs. This urge to compete and win is not unique to America by any means, it is part of being human: man the animal.

    I say bring on the computer chip wars: Lets all compete, Japanese, Americans, Europeans, Russians, come one come all. In the end, we will all benefit, no matter who has the bragging rights for a day.

    --
    Tequila: It's not just for breakfast anymore!
  8. Link to the Earth Simulator Center by GeoGreg · · Score: 3, Interesting

    If you'd like to see what these people are up to for yourself, here is a link to their website. Lots of performance data, lists of projects, etc.