Slashdot Mirror


Supercomputers To Move To Specialization?

lucasw writes "The Japan Earth Simulator outperformed a computer at Los Alamos (previously the world's fastest) by a factor of three while using fewer, more specialized processors and advanced interconnect technology. This spawned multiple government reports that many suspected would ask for more funding in the U.S. for custom supercomputer architectures and less emphasis on clustering commodity hardware. One report released yesterday suggests a balanced approach."

15 of 174 comments (clear)

  1. Cost comparison? by Tyrdium · · Score: 4, Interesting

    Ignoring size, how does the cost of a cluster of fewer, highly specialized computers (with special interconnects, etc.) compare with that of a cluster of more, less specialized computers?

  2. performance vs cost by harmless_mammal · · Score: 4, Interesting

    Teraflops per dollar is important, let's not forget that.

  3. Someone who's knowledge please tell me by Raul654 · · Score: 3, Interesting

    The Japan Earth Simulator outperformed a computer at Los Alamos (previously the world's fastest) by a factor of three while using fewer, more specialized processors...
    What is the difference between processor designed to simulate earthquakes (et al) and an ordinary, off-the-shelf processor? I mean - so they optomized floating point operations. Is that it?

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
    1. Re:Someone who's knowledge please tell me by QuantumRiff · · Score: 3, Interesting
      Generic processors are ineffecient. Imagine having the fastest processesor on earth, and then take that chip and use it to do the calculation of x1++ (thats x1 = x1 +1 for you non-C'ers)and looping it a few Trillion times. Then take a processor that is desinged specifically to do x1++, and only that calculation. You can run a hell of alot faster, you don't need to worry about having to multiply, devide, etc.. they're smaller, and cooler, and after the cost of engineering them, cheaper.

      Can't remember the link, but somebody made a board with a few FPGA chips (I think) that cracked a 56bit DES key in a few days or less, and distributed.net had how many computers working on it for how many years?

      Its all about designing the chip for the application. The ones they are refferring to would probably be designed to do mass computation of heavy physics, and only be able to run custom Nuke Simulation software.

      The thing I am interested in, as an Ex Computer Systems Engineering major, is are they interested in designing and fabbing processors from the ground up, or using an assload of FPGA's or something from a company like Altera and program them..

      --

      What are we going to do tonight Brain?
  4. Specialization by bersl2 · · Score: 4, Interesting

    If you're going to have a supercomputer do one thing, of course specialize it. An Earth simulation surely has a set number of formulae whose calculations are to be optimized as much as possible, even to the hardware level.

    But if you want a versitile, general-purpose supercomputer, why not go with the clustering solution?

  5. Invest in Cray by Teahouse · · Score: 2, Interesting

    Cray is back and getting back into the government contract game. Suprisingly, they are doing it just as the DOD is realizing that they need specialized hardware like they used to when Cray was one of their best suppliers. Look for little ol Cray to be back in the black real quick, and pick up a few shares now.

    --
    "Curiosity killed the cat, but for a while I was a suspect."- Steven Wright
  6. This greatly surprises me by ikewillis · · Score: 4, Interesting
    As an employee of an atmospheric modelling group I am very surprised to hear this. Our atmospheric modelling program, the Regional Atmospheric Modelling System, is not I/O bound in the slightest and is instead very much CPU bound. We currently use 100bT for the interconnect on our cluster, and have tried moving to Gigabit with negligable performance gains.

    The main area in which we saw benefit was switching from the Portland Group Fortran Compiler to the Intel Fortran Compiler, which cut the timestep (simulation time/real time) nearly in half.

    Every cluster in the department is assembled from commodity x86 components. Groups here have been moving from proprietary Unix architectures to Linux/x86 systems and clusters. Our group started out on RS/6000s, then moved to SPARC, and is now moving to x86. In terms of price/performance there really is no comparison.

    As for TCO, the lifetimes of clusters here are relatively short, one or two years at the most. Thus a high initial outlay cannot be set by lower cost of operation.

    1. Re:This greatly surprises me by bathmatt · · Score: 3, Interesting

      I also work in the geophysical modeling arena and you will find that one of the biggest differences in using a purpose build S/C versus a lot of OTS equipment is memory speed. It is typical to reach only 10% of peek efficiency when running an application, even with nice structured problems like you are running. While you claim that you are CPU bound, you really are not. For example, if you run on a slower CPU but with a better memory subsystem or a larger cache (example SGI vs intel/linux) you will find that the SGI will win even though it is a much slower machine on paper. This is because the memory thruput and large cache. Now, to explain why you don't notice the speed up when you went from a 100-1G network, that is because your latency did not change much in that. You are typically sending lots of small packets (assuming you are not doing variable packing and the only atm model I know doing this is WRF) you are never really getting out of the latency mode and not seeing much improvement on the communicatoin speed. This is why people use myrinet (SP) because this can be accessed from the application, not going through the kernel and start transfer much quicker. (For typical latency/bandwidth numbers for a structured grid halo exchange google wallcraft halo and you will get numbers for all different types of machines and code to test yours)

    2. Re:This greatly surprises me by FullyIonized · · Score: 5, Interesting
      And I'm surprised to hear that you are surprised since fluid modeling is one of the applications that do very well with the vector processors that the Earth Simulator uses. I attended a lecture by Dr. Sato, head of the Earth Simulator, who stated that the best application usage was 65% peak usage (the theoretical peak which assumes that the processor always has data to crunch and no branches) and the average was 30% of theoretical peak. By contrast, typical fluid-like codes on current U.S. machines typically get less than 10% of peak usage if they have any type of implicitness (currently the magnetohydrodynamics code I use gives about 6% usage on an IBM SP that is #5 on the Top 500 supercomputer list).

      I get tired of seeing figures that compare peak flop rates and then don't mention that actually code usage isn't keeping up at all. The Japanese (and Europeans who are allowed to buy NEC machines) are absolutely spanking the US when it comes to fluid codes (for climate modeling for example) and it is largely because they are using vector machines with their old highly optimized Fortran (or High Performance Fortran) codes. The MPP revolution in the U.S. has been manna for the CompSci community, but has set the computational physics community back by 10 years (except for those lucky bastards with embarrassingly parallel jobs).

      I would give up an unnecessary body part for an Earth Simulator.

      --
      Sigs are bad for you.
  7. Why oh why? by tomstdenis · · Score: 3, Interesting

    Definitely a really huge super-computer would be neat to have but honestly are they putting the ones we already have to good use?

    From what I've heard [anecdotally] computers like the earth simulator go vastly under utilized for the most part.

    So given that most nations [including the US] have budget problems specially concerning education couldn't people think of better uses for money?

    And before anyone throws a "it's the technology of it" argument my way, I'd like to add that if anything I'd rather have the money spent on researching how to make high performance low power processors [and memory/etc] instead. E.g. an Athlon XP 2Ghz that runs at 15W would be wicked more impressive than a 50,000 processor super computer that runs a highly efficient idle loop 99% of the time.

    Tom

    --
    Someday, I'll have a real sig.
    1. Re:Why oh why? by gsabin · · Score: 2, Interesting

      From what I've heard [anecdotally] computers like the earth simulator go vastly under utilized for the most part.

      From my experience that is mostly untrue, yet widely publicized. Yes, if you look at utilization as the (used-proc*sec)/(totaltime*numprocs) the number can be relatively low (~60-70%). However, that includes system time, rebooting the machine, weekends, holidays, etc. Further, when it comes down to it the researchers need to have a reasonable turnaround time during the day for their development runs (when the utilization is much higher than 60%). Further, since these machines generally run jobs of different sizes from many differnt users there is an upper bound on utilization

  8. Re:The motivation is a tad depressing by Pharmboy · · Score: 4, Interesting

    It took Sputnik to kickstart our spacemindedness; I for one consider it sad that a "tremendous amount of interest" -- and the funding that comes with it -- in high-performance computing seems only to have arisen/regenerated with the influence of competitive international politics. Are we really so hardly advanced that our respective national egos are still the driving force behind enthusiasm, financial or otherwise, in certain areas of science?

    I don't really see that as bad. Yes, it may look like pure ego, but the space race gave us so much that filtered into the commercial/private sector. From advanced computers to Velcro(tm). From my perspective, being the most advanced nation in as many areas as possible is a good defense, both economically and in a homeland security sense.

    Frankly, I don't want the fastest computer chips on the desktop to be designed by a company in another country (even if Intel makes them outside of the US) and I would rather that the cutting edge, be cut here, in my native country. I am sure other people in other countries feel the same, that pushed all of us to new heights. In the end, the technologies are shared anyway. Most anyone in the world can buy Intel chips, for example.

    If no one cared who could race a bicycle the fastest, Lance Armstrong would be just some guy who had cancer. Instead, our desire to compete and excell and outdo our neighbors has benefited EVERYONE a great deal. It can bring out the bad side from time to time, but the benefits far outweigh the costs. This urge to compete and win is not unique to America by any means, it is part of being human: man the animal.

    I say bring on the computer chip wars: Lets all compete, Japanese, Americans, Europeans, Russians, come one come all. In the end, we will all benefit, no matter who has the bragging rights for a day.

    --
    Tequila: It's not just for breakfast anymore!
  9. Link to the Earth Simulator Center by GeoGreg · · Score: 3, Interesting

    If you'd like to see what these people are up to for yourself, here is a link to their website. Lots of performance data, lists of projects, etc.

  10. Re:That's what I mean by Pharmboy · · Score: 2, Interesting

    Speaking as one who has played Civilisation until the late hours of the morning, I can confidently say that the country with the most advanced technology, wins.

    That term makes a lot of people uncomfortable: win.

    People assume that when you have winners, you must have losers. While this is true in Civilization, it need not be true in life. It is true that when America innovates, it may benefit more, but everyone else that uses the product can benefit as well.

    America put more money into developing the Internet, through DARPA, starting in 1969, and many of the companies (not all) that build equipment for using the Internet, from computers to routers, are American companies. But this has created tons of jobs in China and other countries, sparked competition in Europe and the Pacific Rim, and has created many jobs along the way. America certainly didn't do it alone, but it was the Cold War and the space race that fueled much of DARPA, and now, in its adolesence, the internet is just as accessible in England, France, Japan, Brazil or America, and its getting better every year for poorer countries. In this respect, there are winners, and those who are doing better.

    We win in that we develop the most technology, but since it shared, there are very few losers. Some have a problem with the fact that we benefit more, at least initially. Some will always have problems when one group benefits more. I just don't share their world view. I think it was Winston Churchill that said "Capitalism is wealth distributed unequally. Socialism is misery shared equally." (something like that)

    Like most of us, I have no issue with sharing technology and helping others, but I still want to be on the winning team.

    --
    Tequila: It's not just for breakfast anymore!
  11. Re:It does matter by afidel · · Score: 2, Interesting

    Would you rather they simulate weapons or resume detonation testing of new designs?? The fact is the US has a VERY large and ever aging supply of weapons, most of the cycle time so far from the ASCI projects has gone towards stewardship of the existing crop of weapons, making sure that the stockpiles are safe and also that they will be effective(if god forbid they should be needed). Also, reduced consumption is the only thing that will reduce our environmental "problems". Personally I think anyone who thinks the US has much of an environmental problem needs to get out of LA/New York/whichever big city they live in. I have spent a lot of time enjoying the national parks of this great country and I can tell you that there are a lot of pristine wilderness areas and a lot of generally green land here (in fact the US landmass is one of the least densly populated non-desert areas in the world).

    --
    There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.