Slashdot Mirror


Efficient Supercomputing with Green Destiny

gManZboy writes: "Is it an oxymoron to have an efficient supercomputer? Wu-Chun Feng (Los Alamos National Laboratory) doesn't believe so - Green Destiny and its children are Transmeta-based supercomputers that Wu thinks are fast enough, at a fraction of the heat/energy/cost, according to ACM Queue." 240 processors running under 5.2kW (or less!) is nothing to sneeze at. The article offers up this question: might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

193 comments

  1. Holy crap! by Anonymous Coward · · Score: 5, Funny

    I knew that sword was beefy, but that's insane!

  2. Indeed... by WarpFlyght · · Score: 1

    Most definitely nothing to sneeze at. I have to ask, though: how long ago was it insane for a supercomputer to put out as much heat as the average enthusiast PC puts out today?

    --

    "Aye, and if my grandmother had wheels, she'd be a wagon!" -- Montgomery Scott, ST:III
    1. Re:Indeed... by spune · · Score: 0

      And how long yet until we can power a supercomputer with the lights on a christmas tree?

    2. Re:Indeed... by ergo98 · · Score: 2, Informative

      While obviously there is a bit of hyperbole in your statement (I highly doubt there are many systems defined as "supercomputers" that consume less than 3 digits or so of kW...certainly not 400-500W that a worst case enthusiast consumes), I really wonder if home computing has really gotten that much worse. Around 11 years ago I remember getting a 350W power supply for my 386-33 (with Diamond Speedstar 24x!), and this was pretty much par for the course - of course the CPU itself consumed much less power (I think around 5W) than some of the high end CPUs (that can consume up to 80W), however the board and surrounding hardware generally consumed a lot more power then.

    3. Re:Indeed... by WarpFlyght · · Score: 1

      I most definitely concede that supercomputers have most definitely consumed a far greater amount of power traditionally than modern enthusiast machines. I'm more curious about the heat output (I know the figures cited in the original article referred to power consumption, but heat was mentioned). My post was a bit vague. A clarification might help. I wonder how long ago that type of heat output would have been considered extreme in a supercomputer, or perhaps at least in one node making up a supercomputer. Of course when we compare heat output of a traditional supercomputer to a top-of-the-line processor from an enthusiast machine (say a Pentium 4 EE or an Athlon 64 FX), a modern CPU might offer better performance on the order of hundreds of times (if not thousands) for the same amount of heat produced.

      --

      "Aye, and if my grandmother had wheels, she'd be a wagon!" -- Montgomery Scott, ST:III
    4. Re:Indeed... by subk · · Score: 1

      Worst case enthusiast? Hell, my bedroom draws about 3kw... lets not even talk about the living room!

      --
      Now, if you'll excuse me, I have backups to corrupt.
    5. Re:Indeed... by Holi · · Score: 1

      Easy answer, Never In 1976 Cray's were water cooled, and later they were cooled with freon. So no your little desktop has nothing on super computers when it comes to cooling requirements.

      --
      Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
    6. Re:Indeed... by sam0ht · · Score: 2, Interesting
      I'm more curious about the heat output (I know the figures cited in the original article referred to power consumption, but heat was mentioned)

      The heat output is precisely the same as the power input. All electrical power used by the PC is eventually converted into heat in the room, so a 450W PC consumes 450W of electricity and provides 450W of heat.


      Incidentally, if you have a 500W heater in your room, you could replace it with a 500W PC for no extra electrical cost, and the same effect in terms of keeping you warm. Heat can be a good thing !

    7. Re:Indeed... by badmonkey · · Score: 1

      I'm curious about this point: if you have say a 300 Watt power supply in your computer, but your computer guts only draw 200 Watts, does that mean 300 Watts is dissipated into the room, or 200 Watts and the other 100 watts is never "used"?

    8. Re:Indeed... by Bingo+Foo · · Score: 1
      how long ago was it insane for a supercomputer to put out as much heat as the average enthusiast PC puts out today?

      Oh, wait. I thought you said as much heat as the average PC enthusiast. Never mind.

      --
      taken! (by Davidleeroth) Thanks Bingo Foo!
    9. Re:Indeed... by troon · · Score: 1

      A little more than 200W, as the PSU isn't completely efficient, but the spare capacity isn't wasted. A 400W PSU doesn't use 100W more power than a 300W PSU.

      --
      Ydco co ,df C erb-y go. a Ekrpat t.fxrapev
    10. Re:Indeed... by 10Ghz · · Score: 1

      To my knowledge, that's incorrect. Let's say you want to build a router from PC-parts. Via Eden with fanless cooling, no CD/DVD, no HD, vid-card is integrated, system runs from a floppy. It would require under 100W. If you installed a 400W power-supply, the system would not eat 400W of power. It would eat only as much as the system requires (under 100W)

      --
      Lesbian Nazi Hookers Abducted by UFOs and Forced Into Weight Loss Programs - -all next week on Town Talk.
    11. Re:Indeed... by abradsn · · Score: 1

      also note that startup will require more wattage then sustained operation.

    12. Re:Indeed... by amw · · Score: 1

      If you installed a 400W power-supply, the system would not eat 400W of power. It would eat only as much as the system requires (under 100W)

      The parent stated '450W PC', not '450W power supply'. I take that to mean the parent is specifically describing a PC that requires 450W, not a power supply that could potentially supply it.
      --
      Karma: is just a word

    13. Re:Indeed... by Elias+Serge · · Score: 1

      Actually, a 600Mhz fanless eden board has a maximum power consumption of about 15W. Probably more if you maxed out the ram tho.

    14. Re:Indeed... by 10Ghz · · Score: 1

      Which is why I said "under 100 watts" ;)

      --
      Lesbian Nazi Hookers Abducted by UFOs and Forced Into Weight Loss Programs - -all next week on Town Talk.
  3. Perhaps.... by whiteranger99x · · Score: 2, Insightful

    How much of a footprint and weight they take up as a metric to consider? ;)

    --
    Join the TWIT army now!
    1. Re:Perhaps.... by buffy · · Score: 1
      If you're referring to the Green Destiny...the entire cluster, including switches fits into a single 42U rack, using Transmeta-based server blades from RLX Technologies, Inc.. Pretty small footprint as far as 240-node clusters go!

      -buf

      ObDisclaimer: I'm an IT geek for RLX

  4. Old age question for a new generation by mrnick · · Score: 4, Interesting

    The MHZ war has been going on for soooo long that everyone just excepted that faster MHZ related to faster machines. Well, 64Bit computers are placing chip manufactures in a position where they have to market on a platform that declares that MHZ doesn't really matter.

    I think the question is a bit naive though as everyone knows a hundred software tools to rate performance of CPUs rather than just relying on MHZ.

    Nick Powers

    --

    Encryption: I may not agree with what you say, but I will defend your right to encrypt it...
    1. Re:Old age question for a new generation by Zelet · · Score: 2

      I think it is about time that we start thinking - is this one fast than this one? to: Each of these is fast enough for what I do - what other features matter?

      --
      ...And when they came for me, there was no one left to speak out for me." - Martin Niemoeller (1892-1984)
    2. Re:Old age question for a new generation by Alpha+State · · Score: 3, Insightful

      Just look at cars - time was the only thing many people would look at is cubic inches or horsepower. Now most people who buy a car are more concerned with other features - passenger comfort, style, efficiency. I would guess this is a shift from car-oriented people buying cars to everyone buying cars as they became more of a necessity.

      Computer manufacturers are only just starting to see this, making smaller, quieter, cooler-running machines. Hopefully they'll continue to look at what their customers actually need rather than simply putting out chips with higher clock speeds.

    3. Re:Old age question for a new generation by SiliBelgian · · Score: 2, Interesting

      Now most people who buy a car are more concerned with other features - passenger comfort, style, efficiency.

      What ever happened to safety?


      Computer manufacturers are only just starting to see this, making smaller, quieter, cooler-running machines. Hopefully they'll continue to look at what their customers actually need rather than simply putting out chips with higher clock speeds.

      You are talking about computer manufacturers as if they are all in the same business. It's the chipset manufacturers that continue to put out faster and (hopefully) more efficient chipsets and CPU's (which is exactly what they are supposed to do).
      On the other hand there are the ready-made PC assemblers like Compaq, Dell, Fujitsu,... These are the ones deciding whether their products will become smaller, quieter, cooler-running or not. There's plenty of small, well-designed cases and silent coolers (or water-cooling systems) available out there for them, which are of course a bit more expensive then ordinary stuff. Untill recently however, most assemblers would simply choose to save as much money as possible on cables, coolers, cases and those other parts that keep a PC together, to spend it on the newest fastest Intel-CPU. In this way, they were (are) able to offer their customers a big ugly noisy power-draining PC that goes way too fast for their use anyway (MSN chatting mostly) for an affordable price.


      I would guess this is a shift from car-oriented people buying cars to everyone buying cars as they became more of a necessity.

      I'm not really old enough to remember car history (or computer history for that matter), but if that's true, you are 100% correct.

      --


      "Hell hath no fury like a hippo with a machine gun."
    4. Re:Old age question for a new generation by An+dochasac · · Score: 1
      You must live outside of the U.S. As of 2003:
      1. Cars are still promoted primarily by #valves, liters, horsepower and sheer size rather than mpg, reliability, utility and comfort.
      2. Cordless phones and baby monitors are promoted by Ghz, the more the better ;-)
      3. Vacuum cleaners are measured by amps consumed.
      4. Cordless drills and other appliances are measured by volts.
      5. Light bulbs are measured by watts (not lumens!)
      6. Car stereos are promoted by watts (not THD)
      7. Even laptops are measured primarily by Ghz rather than battery life or usability.


      I have heard people (Sun?) promoting Watts/MFlop and Watts/Webtransaction as a useful benchmark for high end servers, but this is the exception rather than the rule. It is still a very power obsessed marketing culture. Do you remember when VCRs were promoted by the number of heads? I the 1960s, transistor radio manufacturers would actually solder in dummy transistors so that they could boast "10 Transistors!" This is exactly where we are with computers. Bus speed, cache size, instructions per cycle, word size, efficiency, usability, reliability are all ancillary to the primary marketing tool: CPU clock speed.
    5. Re:Old age question for a new generation by 4of12 · · Score: 1

      Exactly.

      Looking for cars, of course I can't help but look first at "The One Number", how many horsepower (BTW, OT, does the rest of the world measure automobile performance in Watts?)

      These days, though, I'm very impressed with cars that have a high ratio of horsepower to gas mileage.

      In the metric system, I guess that would reduce to kilograms per cubic second.

      Maybe there's a similar ranking for peak torque vs gas mileage; it would be interesting to see a ranking of cars on this basis...

      --
      "Provided by the management for your protection."
    6. Re:Old age question for a new generation by jandrese · · Score: 1

      You're mistaking what advertisers look at versus what people look at. Advertisers like numbers that are easy to quantify (number of valves, amps consumed) and are bigger than their competition. For the most part, people don't care (or don't even really understand the significance of) these numbers. If you were to tell your average car shopper that this car does 0-60 in 5 seconds, they would have no idea if that is good or bad. They're more likely to choose the one that has the comfortable seat or has four wheel drive or whatever they find valuable.

      Your light bulb comparison is a little flawed, since even flourescant bulbs are sold in "equivelent light to an X watt incandasent bulb" packaging. It should be obvious why. Ask your person if a 1000 lumen bulb is bright, and they'll have no idea, however they do know about how much light they get from a 60 watt bulb. There is no need to complicate the matter for Joe Schmoe.

      --

      I read the internet for the articles.
    7. Re:Old age question for a new generation by An+dochasac · · Score: 1

      You may be right about what consumers really want, but marketing often drives consumers to accept what they don't really want. You have a good point on the light bulbs. I just wish there were a more accurate indicator of brightness. I found the "equivalent to a 60 watt" claims on some compact florescents a bit optimistic. And here in 220V land, I could swear that a generic european 40 Watt incandescent puts out more light than a 40 Watt incandescent back in the USA (just costs more to run here!) Maybe it's time for me to start reading up on black body radiation theory ;-) In the meantime, how about candlepower, that's something easy enough to get our head around, and what a great marketing tool: "GE 10 candlepower christmas tree bulbs, 100,000 candlepower desk lamps...!"

  5. Imagine... by rwa2 · · Score: 0

    a (kinder, gentler) Beowulf cluster of these!

    Speaking of which, why hasn't anyone made an OpenMosix cluster-in-a-box yet?

    1. Re:Imagine... by Dwonis · · Score: 1

      Do you mean ClusterKnoppix? Or, are you talking about the hardware, as well?

  6. Wow by Anonymous Coward · · Score: 0

    Imagine a beowulf cluster of these! Might set my house on fire..

  7. WTF? by Anonymous Coward · · Score: 3, Insightful

    Why bother? If you have to sacrifice computational power for energy efficiency, then what is the point of having a supercomputer? Isn't compute power the whole purpose of having a supercomputer?

    1. Re:WTF? by Anonymous Coward · · Score: 1, Informative

      the premise of the article was that compute power is NOT the only consideration of operating a supercomputer.

    2. Re:WTF? by Anonymous Coward · · Score: 5, Interesting

      No, supercomputers that can do a lot of image processing cannot waste power simply because it might be available.

      Modest supercomputers are used in the military on airframes. Power consumption is important for at least two reasons. First is the wattage and power draw. Second, and more subtle, it that the cooling requirements while flying at high altitude become more important than simple fan noise. Pentiums burn up no matter what you do. PowerPCs@10Watts with conduction cooling will survive.

    3. Re:WTF? by Anonymous Coward · · Score: 0

      Why bother? Why bother?!? Wtf?!?

      The last time I heard, most supercomputer time is sold. The cost of operation has everything to do with the profitability of the computer.

      Also, your logic is totally flawed in saying "you have to sacrifice computational power for energy efficiency". In order to calculate the energy efficiency, you have to calculate the computations/watts. Saying it sacrificed computational power would actually decrease the number operations per watt, making it less efficient, not more.

      Hypothetical -

      Lets say we are making two equally powerful supercomputers, one with transmeta, the other with intel. The transmeta chip is half the speed of an intel chip. The transmeta chip is also half the price.

      To balance out the systems, we need twice as many transmeta chips as intel chips. Since they are half the price we still get the same amount of cpu power for the money.

      Transmeta's chips also happen to be 8 times as energy efficient. So over a year, we get the same amount of operations calculated, but 1/4 the electric bill, no need for an enormous refrigerator, runs quietly, etc.

    4. Re:WTF? by Anonymous Coward · · Score: 0

      Even more to the point, since 3/4 of the electric bill per year is saved compared to the intel solution, about that much money could have been spent initially on more transmeta cpus. So for the same amount of money (when you count the substantial eletric bill), you get a more powerful computer.

    5. Re:WTF? by pipingguy · · Score: 1

      ...cooling requirements while flying at high altitude become more important than simple fan noise

      I would have thought that abundant cool air supply wouldn't be a problem for high-flying aircraft. Duct in outside air and use a simple heat exchanger if worried about airborne contaminants.

      What's the outside air temp at 10,000 feet? Manage it with hot exhaust gas if a steady temperature is required. Where's the worry, freezing the chips?

    6. Re:WTF? by PaulBu · · Score: 1

      You are absolutely right that people do not need to worry about power consumption AS LONG AS THE DAMNED THING DOES NOT MELT! ;-) (and it looks like they are going to be melting pretty soon now).

      Seriously, the power processors dissipate determines how close together they can be packed, and that average distance DOES set an ultimate limit on the latency of communications between the processors (speed of light, you know... ? ;-) ), and, of course, latency means efficiency, or how much a given task can be parallelized...

      Paul B.

    7. Re:WTF? by NoOneInParticular · · Score: 1

      Temperature might be low, but how much air is there at 10,0000 feet? You do need plenty of molecules to exchange the heat with, right?

    8. Re:WTF? by BOFHelsinki · · Score: 0

      For those who didn't quite understand "airborne contaminants", it means pigeons in the intake.

      (Also observe how penguins by nature do not constitute a security risk for airborne supercomputers.)

    9. Re:WTF? by Anonymous Coward · · Score: 0

      The air may be cool, but the heat generated from the unrelentless blast of air at 350 MPH generates a LOT of heat. That is why the Concorde actually stretches 1ft while in flight from the heat generated by the wind on the aircraft's skin.

    10. Re:WTF? by cabra · · Score: 1

      You want to see low power try this option, ok I know it's not new but it's still a good idea. http://www.simtec.co.uk/products/EB110MOD/ less than 5 watts per-board!

      --
      -that's no moon, that's a space station!
  8. Re:I can think of one by Anonymous Coward · · Score: 0

    RE:"Doesn't matter if the inside contains a computer that's half the speed of competing x86 boxes LALL!!!"

    or if it is just has a squirril cage and a rat...

    in spite of my rage i am still just a rat in a cage

  9. An important metric... by Anonymous Coward · · Score: 0

    ...would be how large a Quake Death Match it could host. Now if they could make a Beowulf cluster with these...
    OK, the obligatory /. observations are out of the way. Rational discussion can^H^H^H may begin.

    Rick

  10. Old news. by Anonymous Coward · · Score: 0

    This was on The Register AGES ago... I remember it well, because that's where I learned of the Gelsinger Coefficient.

  11. Would native VLIW be better? by steveha · · Score: 1

    For this specific application, scientific supercomputing with a blade architecture, would native VLIW offer any performance benefits?

    If it would only be a few percent, it wouldn't be worth it. Transmeta has picked the game they want to play, and it would be a big deal at this point to engineer a special version of their chips that make it possible to run native VLIW code.

    I'm guessing that typical scientific processing involves a lot of loops that run many iterations, which is the ideal situation for the code morphing engine; so I'll go out on a limb and predict that it is not worth it to make a special version of the chip.

    steveha

    --
    lf(1): it's like ls(1) but sorts filenames by extension, tersely
  12. Does it really save that much power? by toddestan · · Score: 3, Interesting

    I was talking to a friend the other day about a bunch of lab computers that my school is getting rid of - a bunch of old Pentium MMX's. He suggested turning them into a cluster. But after thinking about it, I realized that the group of about 10 old computers we had would consume more power - and would likely be considerably slower than a single one of the 2.4Ghz Dell's that replaced them. "What's the point?" I said.

    Applying that here, the little VIA chips run at roughly the speed of a Celeron 500 or so, I'd say something like an AMD Athlon 3GHz would be just about as fast as about 6 of the VIA chips. So you are still saving some power, but as not as much as it would seem as first, as you need many low power chips to equal the speed of one faster chip. Not to mention power consumed by having more motherboards, network cards, switches, and other associated hardware.

    Something to really look at is the cluster of G5's. The G5 chips use a lot less power than their x86 counterparts. I bet that cluster of G5's is probably right up there in terms of processing power per watt as this VIA super computer. And it's way more cool to boot.

    1. Re:Does it really save that much power? by iammaxus · · Score: 1

      Well this article was essentially trying to prove that the transmeta's did have a high processing power for their heat output. It would seem you'd be right at first, thats what makes this idea interesting.

    2. Re:Does it really save that much power? by Svartalf · · Score: 5, Informative

      You're comparing apples to oranges, not to mention that your info's a little off...

      1) A Nehemiah core C3 runs really close to the same performance of a comparably clocked Celeron, with the same general power consumption of a Samuel2 core (For those that don't know, part of how VIA's chip originally got it's low power is that the FPU was underclocked by a factor of 1/2). It's a nice chip overall, but it's not really intended (nor are they USING it that way) for scientific or gaming applications even though you can use it for that. The C3's winning usages is in something like a media PC, workgroup servers, and embedded systems where you need low power consumption, relatively low cost, and relatively high performance compared to other x86 embedded solutions.

      2) The Crusoe and similar chips are very fast executing VLIW CPUs (very much like the Itanium...) that have code morphing that translates x86-32 instructions into comparable sets of instructions for the VLIW CPU- in fact it's very good at doing this sort of thing. The reason it's less desirable with a desktop or gaming application is that you're exceeding the VLIW code cache regularly, meaning you have to keep recompiling the x86 instructions into the native VLIW ones. For a scientific application, the same task gets executed time and time again and usually ends up with most, if not all, of the code in the pre-morphed code cache. At that point, you're now in the high-performance domain with very little power consumption. The Crusoe in this application would consume less power than the G5 and run just as fast. (Check the article that you're commenting on...)

      Do some thinking outside of the box here, what's good or great on a desktop machine isn't always the optimal choice for supercomputing clusters or HA clusters. Depends on a bunch of factors, including what you're going to be running on the systems in question and what kind of environmental conditions you're going to be facing.

      --
      I am not merely a "consumer" or a "taxpayer". I am a Citizen of the State of Texas
    3. Re:Does it really save that much power? by Hoser+McMoose · · Score: 1

      The IBM PowerPC 970 (aka G5) does not use "a lot less power" than similar x86 chips. They're well within the same order of magnitude, and in fact the G5 and the AMD Athlon64/Opteron consume basically the same amount of power at the same clock speed. The Pentium4 consumes a bit more, but not by much. IBM doesn't bother documenting the power consumption of their processors (actually they don't bother publicly providing much useful documentation at all), but they listed the "typical" power of the 1.8GHz G5 at 48W. Given that "typical" power is usually around 75% of the maximum power consumption, and scaling things up to 2.0GHz, you're probably looking at about 70W of power. A bit lower than the 82W of power that the top-end P4's consume, but not by much.

      That beign said, you're on the right track with the PowerPC idea. IBM's Blue Gene/L design uses and offshoot of the PowerPC 440 processor and manages some VERY impressive performance/W, probably a whole heck of a lot more than any of Transmeta chips are going to manage.

    4. Re:Does it really save that much power? by rawgod0122 · · Score: 1

      The point would be to have a small cluster (5 nodes would do 4 cluster + a login box) so you could learn how to code/admin that type of thing. All of the software is free and the hardware is free to you. So take a spin at learning MPI, OpenMOSIX, or sockets programming!

    5. Re:Does it really save that much power? by ameoba · · Score: 1

      When you say "A Nehemiah core C3 runs really close to the same performance of a comparably clocked Celeron" you gloss over the fact that having "the FPU was underclocked by a factor of 1/2" ends up giving you far less floating-point performance than an equivalently-clocked Celeron; a difficult feat.

      Considering that FPU performance is particularly useful in scientific apps, this makes VIA chips nearly worthless there. Epia boards are cute & fit in toasters, but not really practical or cost effective.

      --
      my sig's at the bottom of the page.
  13. Hmm... by Axeling · · Score: 1

    While the points that the author makes are true about the "frugal consumer", those aspects are not applicable to supercomputing.

    Overall performance is much more important than efficiency. While efficiency is commendable at all computing levels, if efficiency is a very important aspect, then a supercomputer is probably not for you.

  14. Re:Green Destiny by Anonymous Coward · · Score: 0, Offtopic

    Post #7517209 (above) is plagarized from Post #7214390. Don't mod up plagarism!

  15. Do the math by InodoroPereyra · · Score: 5, Interesting
    This is very, very cool. For one thing, a bottleneck in supercomputers is in most cases the network. In this regard, dropping some per/node performance might not affect the overall performance for applications that need intensive interprocess communication.

    The other point is: how expensive it is to support a cluster ? Not only the energy consumption, but also the infraestructure. It is pretty darn difficult to keep a thousand processors cold. You may need a special building, special power supply for it, etc.

    A final point: as far as I know, the rule of thumb is that the floating point performance with these energy efficient processors is of the same order of magnitude as regular processor, may be a factor 2 difference.

    You do the math ... :-)

    1. Re:Do the math by Jeff+DeMaagd · · Score: 2, Interesting

      My question is whether this is more efficient per TFLOP than IBM's PPC unit, which is IIRC smaller than a rack and houses 1024 PPC chips.

      I really can't tell now that the site is slashdotted. The CPU in this case can't be that much of a burden if they run around five watts. I am curious if 80% of the heat generated here is simply networking.

    2. Re:Do the math by dunedan · · Score: 1

      Can't swear to it but I have heard here on slashdot from others that Green destiny sits in one rack and requires no special climate control. Since these morph x86 code and retain that translation they are very efficient when they run the same loops over and over as in scientific computing

    3. Re:Do the math by joib · · Score: 1


      For one thing, a bottleneck in supercomputers is in most cases the network. In this regard, dropping some per/node performance might not affect the overall performance for applications that need intensive interprocess communication.


      OTOH, with faster nodes you need fewer nodes and thus also less network traffic.

      IIRC, the green destiny uses plain ethernet for networking, so it won't be able to compete with higher end cluster interconnects anyway (ethernet latency kills performance for many applications). However, the general idea is very neat and worth developing further, IMHO.

    4. Re:Do the math by bigsmelly · · Score: 1

      Hmm.. that's something to think about.

      Once you have the infrastructure (i.e. big pipe, specialised air-con, power supply)

      Does it get much cheaper to "upgrade" yor Supercomputer, buying in a new one every ten years or so?

    5. Re:Do the math by ameoba · · Score: 1

      It is pretty darn difficult to keep a thousand processors cold

      You're saying it. At the (undisclosed southwestern desert location) high-performance computing center on campus they have problems during the summer. On some of the hottest days, they have to stand outside with a garden hose & spray down the cooling-coils on the main AC unit, or else the whole system goes down. The system can handle the load, it just can't get the heat out of the system when it's 100F outside.

      --
      my sig's at the bottom of the page.
  16. Bigger clusters by Dwonis · · Score: 1

    If your supercomputer cluster nodes are cheaper/more energy efficient, then given a fixed budget, your supercomputer can be bigger!

    1. Re:Bigger clusters by Anonymous Coward · · Score: 0

      omg captain obvious

  17. Laptop/Desktop/Handheld Supercomputers? by Qweezle · · Score: 1

    This makes me wonder if such a configuration might find its way into ordinary extreme performance desktop/laptop computers.

    Especially with the new wave of Media Center based PCs...small small machines that are very powerful....is THIS the future of servers? Perhaps in a few years my web pages will all be served up from something like a handheld PC, with several processors and always-on WiFi? The possibilities are endless, but I see this DEFINITELY making it into laptops of some creed...those ultra-high-performance ones that nobody seems to buy.

    Vivan los pocos!

  18. Re:Green Destiny by ArgoTango · · Score: 2, Interesting

    Robert Cringely pointed out the benefits of this tradeoff (pure speed vs. low heat/hihg maintainability), pointing to Google's use of Pentium III-s for their server farms.

  19. Re:Green Destiny by Anonymous Coward · · Score: 1, Informative

    Mod parent DOWN -- was copied from another post!!

  20. supercomputers vs man's only finite resource by WiPEOUT · · Score: 5, Insightful

    Why are supercomputers primarily benchmarked by their speed? The answer comes when you consider that almost all labour-saving devices are measured in the work they perform in a given period of time.

    Time is the only truly finite resource from a human perspective. As technology has progressed, distances have been conquered, vast energies harnessed, but old Father Time is still inescapable.

    As a result, we place great value on just how much time is taken to accomplish anything.

    1. Re:supercomputers vs man's only finite resource by cfuse · · Score: 1
      Time is the only truly finite resource from a human perspective. As technology has progressed, distances have been conquered, vast energies harnessed, but old Father Time is still inescapable.

      With advances in quantum physics, who knows how long this will be the case?

    2. Re:supercomputers vs man's only finite resource by Anonymous Coward · · Score: 0

      [Man] I need the answer to a question
      [Computer] The answer is 42
      [Man] I haven't given you the question yet!
      [Computer] Computing....
      *Man's head explodes*

    3. Re:supercomputers vs man's only finite resource by El+Cubano · · Score: 1

      Time is the only truly finite resource from a human perspective. As technology has progressed, distances have been conquered, vast energies harnessed, but old Father Time is still inescapable.

      It seems that at least one person claims to have conquered time.

  21. Nano-ITX by PureFiction · · Score: 2, Interesting

    with the centaur C5P processor core. Draws about 8W for the chip @ 1Ghz. Lets assume 12W total for network boot.

    [ see image here: peertech.org/hardware/viarng/image/nano-itx-c5p.jp g ]

    With 5,200 Watts for Green Destiny, you could use 433 boards these boards for the same power consumption.

    The on chip AES is clocked at 12.5Gbps, Entropy at 10Mbps (whitened). Thus you would have

    422Ghz of C5 processor power
    5.412TB/s of AES (yes, terabytes)
    4.22Gbps of true random number generation.

    Yeah, these are really rough estimates, but that is a long of bang for your kilowatt buck no matter how you slice it.

    With a cutting edge P4 approaching 100W the efficiency of these less powerful but fully capable systems will become increasingly attractive.

    I would not be surprised to find bleeding edge processors relegated to gamers and workstations as most computing tasks start migrating towards small, silent, low power systems that simply *work* without eating up desk space, filling a room with fan noise and driving the electricity bill higher with continuous 100's of W draw.

  22. Re:imagine a beowulf cluster ... running oracle 10 by Anonymous Coward · · Score: 0

    No shit. Long live tinfoil hats.

  23. more important metrics that just speed? by daveking · · Score: 1

    might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    Yes, people often consider flops/watt to operate, and flops/dollar to buy.

    Speed alone means nothing. All these atoms in my apartment can do billions of operations per second, but they can't even play mp3s.

    --
    ------DO NOT WRITE BELOW THIS LINE------
  24. well hey by ShadowRage · · Score: 1

    remember when computers were big enough to be in warehouses? and 10 years ago, people theorized that computers would be small enough to fit in your watch or hand? and that was just theory and considered fiction.

    now we have palm pilots and watches that can store data (see the usb wrist watch)

    so, really, a supercomputer that doesnt use that much energy isnt impossible.
    anything's possible, one just has to break through the set barriers technology has made. if no one did that, we still would be sitting around in caves.

    1. Re:well hey by Anonymous Coward · · Score: 0

      Someone commented on slashdot before that while the VT G5 supercluster is currently #3 in the top500 list, a solitary dual-g5-powermac would have made it to number 7 in the world 10 years ago (the 1993 list)

    2. Re:well hey by tgt · · Score: 1

      Perpetuum mobile was impossible two thousand years ago, is impossible right now, and is impossible in the future, unless modern physics is totally whacked out. And we ARE sitting in concrete caves dreaming about efficient power sources.

      --
      I like my outfit, it's inexpensive, but cool -- April Ryan
  25. Other methods besides speed?? by Anonymous Coward · · Score: 0

    What does he want, affirmative action for slow CPUs?

    Power is a consideration in TCO.. At the end of the day it comes down to $$/TFLOP (etc).

  26. Times change by m8te · · Score: 3, Insightful

    Lottsa years ago I used to maintain a CDC 7600, not only did it need full refrigeration, but it's original design spec was for an MTBF of 15 hours! The designers reckoned that it was so fast that the biggest job imaginable could be run in that time. Of course it did better than that in the end, but it was a bugger of a job to fix, and the backplane was 6 inches deep in twisted pair wires. Just imagine making wiring changes.

    1. Re:Times change by Tore+S+B · · Score: 1

      Times do indeed change. But, however, I must protest on your MTBF quote. MTBF was *NOT* 15 hours. The CDC7600 was a reliable computer with lavish redundancy. Interestingly, some books quote the MTBF as 9.1 hours, but this was due to every job inside the OS for the 6600 and the 7600 had a Maximum Job Time Limit, but this could easily be overridden by storing a checkpoint memory dump, and restoring from the tape automatically. Quoting a reliable source (ed-thelen.org) "(Our 6600's ran months with out unscheduled maintenance time. Every few months the CDC Customer Engineers would (rather rudely) demand machine time - like to do Engineering Change Orders)" and "To give an idea of the reliability of the 6600, I liked to program and calculate Pi as a method of learning a new machine's assembly language. I did it to 500,000 decimal places in about 60 hours on a CDC-6600 one Thanksgiving weekend. Because of the length of time, I had to write a check point dump of the intermediate results after 8 hours, and restart the job from the check point dump, over and over until the job was done. That meant I went into work every 8 hours all during that weekend until the 60 hour running time was complete. There was no worry on my part that the 6600 would fail during that weekend run - and the value of Pi was correct as determined later from faster machines with larger memories."

      --
      toresbe
  27. from the so-obvious-it-hurts dept. by Tom7 · · Score: 2, Informative

    The article offers up this question: might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    Um, yes?

  28. green destiny? by Anonymous Coward · · Score: 0

    sounds like some kind of floor cleaner!

    1. Re:green destiny? by Ilan+Volow · · Score: 1

      Green Destiny sounds like a new strain of high-powered, genetically engineered weed.

      I could just see the DEA raiding Los Alamos after getting reports of computer scientists blowing entire afternoons on "their smoking Green Destiny"

      --
      Ergonomica Auctorita Illico!
    2. Re:Green Destiny? by s00p41337h4x0r · · Score: 1
      can it...conquer the Chinese underworld in the hands of a rebellious Manchurian girl?

      Well, we saw that it can *render* like no one's business. Harharhar.

  29. Re:J00 D1D N07 D0 17 317H3R! :-p by Anonymous Coward · · Score: 0

    yeah but he got modded +1. 0wned

  30. w00t! by Anonymous Coward · · Score: 0

    Insightful like a motherfucker! Highfive!

  31. Do the comparison with VT X instead of ASCII Q by 2nd+Post! · · Score: 3, Informative

    If you do the math with X (10,280 instead of 13,880 performance, 1000sq instead of 21,000sw, and 800kw instead of 3,000kw) you get a 337 fold increase in performance per square foot, rather than 65, and an 832 fold increase in performance per Watt, rather than 300 fold, vs the Cray.

    Of course I dunno the numbers for the Transmeta solution yet!

  32. NOP like there's no tomorrow! by droleary · · Score: 1

    . . . might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    No. I have a rock that can sit and do nothing, consuming considerably less than even 5.2kW. You can talk efficiency and bang-for-buck all you like, but if you don't benchmark faster than (roughly) 100 common desktop machines, you don't get to call yourself a supercomputer.

    1. Re:NOP like there's no tomorrow! by Anonymous Coward · · Score: 0

      Well if the fastest super computer in the world broke down every 5 minutes, I guess the rock and the speed have something in common.

      Super Computer Feature Requirements: Speed, Reliability, Size, and Maintenance Cost (which include power consumption, repair,...)

    2. Re:NOP like there's no tomorrow! by staaktdenarbeid · · Score: 2, Insightful


      That only shows how timely the definition of a supercomputer is. 100 common desktop machines are very uncommon and obsolete 3 years from now.

      I think energy efficiency (MOPS/Watt) is a very relevant metric. The reason why my PDA cannot do wideband software radio or anything that needs lots of GOPS is energy-efficiency. If the same PDA could carry 100 XScale processors instead of 1 with the same battery lifetime, I'm sure we'll have applications for it in no time.

    3. Re:NOP like there's no tomorrow! by droleary · · Score: 1

      That only shows how timely the definition of a supercomputer is. 100 common desktop machines are very uncommon and obsolete 3 years from now.

      Right. I recall Apple making a big stink a few years back about being a desktop supercomputer when they hit 1 GFLOPS, or whatever the benchmark was that initially established the first supercomputers. What makes a computer "super" while Moore's law is still being met will definitely change over time.

      I think energy efficiency (MOPS/Watt) is a very relevant metric.

      Only inasmuch as electricity costs money, and those costs can be compared to the cost of pushing more horsepower at the problem. I mean, if you have some calculations that daily require a 1 TFLOPS cluster (say some weather prediction), it doesn't much matter if you can get a .5 TFLOPS cluster that consumes 75% less power. Yeah, in theory you could get two, but there are coordination costs and scaling inefficiencies that would have to be dealt with so that in order to actually see 1 TFLOPS from the the second architecture it might end up being less efficient and requiring more energy.

      All I'm saying is that if they want to claim any sort of efficient supercomputer, they have to have something on the Top 500 list and then worry/brag about what kind of low power consumption it has.

  33. Do companies care? by TwistedKestrel · · Score: 1

    The article offers up this question: might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    Yeah. Does the supercomputer do what the customer needed it to do? Nobody in the world lays down money for a "supercomputer" these days so that they can be the fastest kid on the block ... or at least they shouldn't. Ostensibly, there are massive amounts of computing work that they need done, and they need something that can do it in a reasonable amount of time. Beyond that ... was it worth their money? If the answer to the last two questions was yes, then it was a success. Supercomputers are a tool; a very large tool, but a tool nonetheless.

  34. Re:I can think of one by UnknowingFool · · Score: 1
    if the inside contains a computer that's half the speed of competing x86 boxes

    Let me get this straight, you're comparing overall computing performance of a chip based solely on its clock speed? You must be new around here.

    --
    Well, there's spam egg sausage and spam, that's not got much spam in it.
  35. Imagine reading the beowulf mailing list! :-) by Anonymous Coward · · Score: 1, Informative

    Anyone interested in this sort of thing should check out the Beowulf mailing list - go to www.beowulf.org, and read through the (recent) archives. There's been some talk lately on different metrics.

  36. Re:Green Destiny by skookum · · Score: 1

    Oh bullshit. This is a total troll, are you kidding me?

    5.2kW cannot be sucked out of "a normal building power strip." And you are sure as heck going to notice 5.2kW of heat, and the regular everyday HVAC is most definitely not all it requires. "Uncooled ordinary room" my ass.

  37. Still trying to read past the first page by 2nd+Post! · · Score: 1

    But if you do the math (clipped from another post of mine)
    If you do the math with X (10,280 instead of 13,880 performance, 1000sq instead of 21,000sw, and 800kw instead of 3,000kw) you get a 337 fold increase in performance per square foot, rather than 65, and an 832 fold increase in performance per Watt, rather than 300 fold, vs the Cray.

    And I don't know what the numbers for the Transmeta solution is.

  38. Memory Speed by rf0 · · Score: 2, Interesting

    Its not CPU speed that is important in supercomputer/clusters it is the speed at which you can get data from one node to esp memory access. If you havea 512 node system and node 3 needs a copy of node 40's memory it has to copy it over.

    If its even just 512Mb of Gigabit ethernet and assuming 100% performace it would still take 5 seconds which is many orders of magniture. Just look at SGI machines which use NUMA and their Cray-Linux are 3.2 TeraBytes (bytes not bits). Now thats how you want to shift data

    Rus

    1. Re:Memory Speed by DeathPenguin · · Score: 1

      Yep. That's the reason high-speed interconnects such from companies like Mryinet and Quadrics are used for real clusters. It's also the main selling point of Cray's Red Storm.

  39. Money is finite too by kimbly · · Score: 2, Insightful

    Money is usually finite, too. Especially in research. Power costs money. Cooling also costs money.

    1. Re:Money is finite too by SiliBelgian · · Score: 1, Funny

      But time is money, Mr. Redundant.
      moving on...

      --


      "Hell hath no fury like a hippo with a machine gun."
    2. Re:Money is finite too by TubeSteak · · Score: 2, Interesting
      Commercial, Industrial & Institutional entities usually get a nice big fat discount on power and water. That said, your comments dovetail nicely with this article I just read.
      At Penn State University, electrical consumption in October was 33 million kilowatt hours, up from 27 million in October 1996. The school's electric bill is about $1 million a month. Paul Ruskin, with the university's physical-plant office, said power use by the 13,000 student residents contributed to the increase. Some officials say higher energy costs, campus expansions, lighting and the addition of computer labs and other energy-eating facilities are more to blame for increased power demand than student appliances.
      Later on they talk about the costs of upgrading the electrical systems in dorms/buildings built during the 1950s & 60s which can't handle the loads being placed on them. At some point, power consumption will have to stop increasing or massive upgrades to the basic infrastructures will be needed (see the blackout of 2003 for reference)
      --
      [Fuck Beta]
      o0t!
  40. Efficiency by ear2ground · · Score: 1

    Is it an oxymoron to have an efficient supercomputer?

    I thought heat was the real poison of "ultimate" computing...
    So it seems likely computers will move towards those limits and become 'greener' with respect to how much energy they use...

    To do otherwise would be counterproductive in terms of both efficiency and ecology.
    That's needed given how much energy the US is using

    Not a bad thing - but I wonder when green will move towards a technology that means less polluting in terms of hardware that gets trashed every year.

    --
    Subduction leads to orogeny
  41. Re:Green Destiny by goombah99 · · Score: 1

    thanks for noticing and giving me the credit. the original post was indeed mine. this pig copied it.

    --
    Some drink at the fountain of knowledge. Others just gargle.
  42. Being green is important by shaneb11716 · · Score: 4, Funny

    Especially when simulating nuclear weapons.

    -Shane

    --
    I love teh int4rw3b!!!!!111one1
    1. Re:Being green is important by Walterk · · Score: 1

      Yeah, but how does the Green Destiny fit in with supercomputing?

  43. The "other" metric by Anonymous Coward · · Score: 0

    The only metric that really matters : total cost / insutuction.

    Total cost equals the sum of the following:
    1) cost for the CPU+memory+I/O,
    2) cost of energy to power the CPU over it's lifetime,
    3) cost of floorspace to house the CPU including cooling,
    4) cost to write/purchase software for that particular CPU.

    The system with the lowest total cost/instruction wins.

  44. depends on the TASK... by TheSHAD0W · · Score: 2, Insightful

    It's still valuable to have one or a few really friggin' fast processors versus a whole lot of smaller processors if you're running tasks that can't easily be subdivided. This is why people are still buying single processor PCs rather than multiprocessor boxen. If you're buying the setup for a specific purpose and multiple slower CPUs will do the job for you, then that's great; but you'll get more flexibility with speedy processors.

  45. Too bad it's not out yet... by wirelessbuzzers · · Score: 1

    I'm considering building a server off the Nano-ITX, depending on price. Something the size of a small book to sit in a corner or on my desk, serving files over SSH with all that crypto acceleration. It will be a really cool platform... when it comes out.

    Nano-ITX was annonced only a month and a half ago, and hasn't been released yet. So at least wait until the end of the year when they get it out before suggesting building beowulf clusters out of it.

    --
    I hereby place the above post in the public domain.
    1. Re:Too bad it's not out yet... by PureFiction · · Score: 1

      Q1 '04

      see also the SMP dual C5P mini-itx:

      Small is beautiful @ extremetech

  46. Re:Green Destiny by Anonymous Coward · · Score: 0

    let us do some math...
    5.3 kW ..
    let use a power factor of 0.75...
    then the figures for VA is about 7kVA.
    now, use a standard 220 V (RMS), so AMPS are about 32 AMPS. I'm sure that a standard #10 AWG power cable can handle that current (60 amps, in fact).
    SO, maybe not your normal power strip.. but sure a circuit no bigger that the one you use for your electric clothes dryer can provide that power. :-D

  47. cheap super computer by Anonymous Coward · · Score: 0

    Here is my 2 cents.
    Buy In-Win MicroATX BT553 ($38), PC Chips M810CDLU with on board duron +2000 ($69)
    and 3NET NIC ($3) from newegg.
    Add 1GB Memory from crucial ($140)
    You will have a node for around 250$.
    Make 20 of this guys and you have a super computer for $5000.

  48. Less heating=Denser packing by gabbarbhai · · Score: 2, Interesting

    If one can pack the processors more densely, it would cut down on the wiring etc, or allow much shorter paths between nodes (better still, one might be able to stuff many processors on the same board or something), thereby increasing bandwidths (when you try to increase bus speed, path length and related current leakages etc do pose problems). This in turn means computations that require more 'random' communication between nodes can speed up. I suppose that's definitely worth pursuing for the more fine-grain computation where communication bandwitdh is the bottleneck.

    1. Re:Less heating=Denser packing by DeathPenguin · · Score: 1

      Check out DQ some time.

      You're right about heat and density. Heat and density are directly associated. It's the reason 1.6U Evelocity nodes were chosen for Orange instead of .8U nodes used in Pink.

  49. Green Destiny? by Comatose51 · · Score: 1
    Wu-Chun Feng (Los Alamos National Laboratory) doesn't believe so - Green Destiny and its children are Transmeta-based supercomputers that Wu thinks are fast enough, at a fraction of the heat/energy/cost, according to ACM Queue.

    Yes, yes, those numbers are impressive but can it be used to destroy other weapons and conquer the Chinese underworld in the hands of a rebellious Manchurian girl? (Reference: Crouching Tiger Hidden Dragon)

    --
    EvilCON - Made Famous by /.
  50. Why does a supercomputer need x86 compatibility? by hoof · · Score: 3, Interesting

    That is the only advantage of using a Transmeta CPU. Wouldn't it be more efficient to just use a regular VLIW CPU without all the x86 code morphing stuff?

  51. G5 = HOT by TubeSteak · · Score: 2, Interesting
    Article
    Running 1,100 computers in a 3,000-square-foot (280-sq-metres) area sends the air temperature well over 100 degrees Fahrenheit (38 Celsius).

    The heat is so intense that ordinary air conditioning units would have resulted in 60-mph (95 km/h) winds. Specialised heat exchange cooling units were built that pipe chilled water into the facility.

    "There are two chillers for this project," explained Kevin Shinpaugh, Director of Cluster Computing.

    "They're rated 125 tonnes each in cooling capacity, and they pump 750 gallons per minute each. The water is at about 45 degrees Fahrenheit."

    The power supply was another huge challenge. The supercomputer uses the same amount of electricity as 3,000 average sized homes.
    I think the idea behind using low heat output CPUs is that you'll save money in other places. Its a trade off of sorts. More processors, but less expenses on cooling and power. I agree that power consumption by peripherals needs to be looked at too. To be fair to the G5, the AMD64 processors run about 2x as hot.

    I'd like to see an analysis that allows you to cost (i'd say price, but its not just about money) the different components of a supercomputer and account for things like power, cooling, weight, size, infrastructure etc. The factors would have to be weightable so that you can assign varying levels of importance(like if space is more precious than money). It wouldn't need to be indepth or terribly exact, but i think it would help bring out the best possible choices.

    --
    [Fuck Beta]
    o0t!
  52. Re:Green Destiny by skookum · · Score: 1

    Most regular circuits are rated at 20 amps maximum. And that's with 110V that we have here in the US, where this thing is located. That means you'd need double the current, 64 A. Sorry, not from a "Normal building power strip."

  53. Re:I can think of one by andrew_mike · · Score: 1

    Have you ever tried picking one of those things up? I have. I worked on the G5 cluster. Those SOBs were heavy. Nice to look at, but they suck to bring to LAN parties.

    --
    Being a smartass is a much better thing than being the alternative.
  54. Steam powered PC by Neo-Rio-101 · · Score: 1
    I wonder if it's actually possible to reuse the heat generated by your average overclocked processor.

    Maybe it would be possible to convert the heat from the processor into more electricity somewhere else. That would be cool.

    --
    READY.
    PRINT ""+-0
    1. Re:Steam powered PC by DeathPenguin · · Score: 1

      Just a guess, but I can only imagine that the energy required to create such a system would be greater than the energy returned by using it.

  55. Come again? by mblase · · Score: 1

    Now most people who buy a car are more concerned with other features - passenger comfort, style, efficiency.

    I don't know anything about you, but I'm now absolutely certain you're not a resident of the United States.

  56. The short answer? by psoriac · · Score: 0

    No.

    Faster, ever faster!

    --
    I browse Slashdot at +3, Funny
  57. The most important metric! by Anonymous Coward · · Score: 0

    might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    A supercomputer needs lots of blinkylights that flash in random patterns that people can try to find a pattern in...

  58. Full Formatted Text by TubeSteak · · Score: 4, Informative
    Sorry, no Tables and no Pictures

    Making a case for Efficient Supercomputing
    From Power
    Vol. 1, No. 7 - October 2003
    by Wu-Chun Feng, Los Alamos National Laboratory It's time for the computing community to use alternative metrics for evaluating performance.Motivation

    A supercomputer evokes images of big iron and speed; it is the Formula 1 racecar of computing. As we venture forth into the new millennium, however, I argue that efficiency, reliability, and availability will become the dominant issues by the end of this decade, not only for supercomputing, but also for computing in general.

    Over the past few decades, the supercomputing industry has focused on and continues to focus on performance in terms of speed and horsepower, as evidenced by the annual Gordon Bell Awards for performance at Supercomputing (SC). Such a view is akin to deciding to purchase an automobile based primarily on its top speed and horsepower. Although this narrow view is useful in the context of achieving performance at any cost, it is not necessarily the view that one should use to purchase a vehicle. The frugal consumer might consider fuel efficiency, reliability, and acquisition cost. Translation: Buy a Honda Civic, not a Formula 1 racecar. The outdoor adventurer would likely consider off-road prowess (or off-road efficiency). Translation: Buy a Ford Explorer sport-utility vehicle, not a Formula 1 racecar. Correspondingly, I believe that the supercomputing (or more generally, computing) community ought to have alternative metrics to evaluate supercomputersspecifically metrics that relate to efficiency, reliability, and availability, such as the total cost of ownership (TCO), performance/power ratio, performance/space ratio, failure rate, and uptime.

    Motivation

    In 1991, a Cray C90 vector supercomputer occupied about 600 square feet (sf) and required 500 kilowatts (kW) of power. The ASCI Q supercomputer at Los Alamos National Laboratory will ultimately occupy more than 21,000 sf and require 3,000 kW. Although the performance between these two systems has increased by nearly a factor of 2,000, the performance per watt has increased only 300-fold, and the performance per square foot has increased by a paltry factor of 65. This latter number implies that supercomputers are making less efficient use of the space that they occupy, which often results in the design and construction of new machine rooms, as shown in figure 1, and in some cases, requires the construction of entirely new buildings. The primary reason for this less efficient use of space is the exponentially increasing power requirements of compute nodes, a phenomenon I refer to as Moore's law for power consumption (see figure 2)that is, the power consumption of compute nodes doubles every 18 months. This is a corollary to Moore's law, which states that the number of transistors per square inch on a processor doubles every 18 months [1]. When nodes consume and dissipate more power, they must be spaced out and aggressively cooled.

    Figure 1

    Without the exotic housing facilities in figure 1, traditional (inefficient) supercomputers would be so unreliable (due to overheating) that they would never be available for use by the application scientist. In fact, unpublished empirical data from two leading vendors corroborates that the failure rate of a compute node doubles with every 10-degree C (18-degree F) increase in temperature, as per Arrenhius' equation when applied to microelectronics; and temperature is proportional to power consumption.

    We can then extend this argument to the more general computing community. For example, for e-businesses such as Amazon.com that use multiple compute systems to process online orders, the cost of downtime resulting from the unreliability and unavailability of computer systems can be astronomical, as shown in table 1millions of dollars per hour for brokerages an

    --
    [Fuck Beta]
    o0t!
  59. It's about time by Anonymous Coward · · Score: 0

    Well, it's about time they realize clock speed is the only thing to look at. Most people don't use the cycles they have on a 4 or 8 cpu box! Imagine if they started to clock disk I/O to a shared source! What would happen to the supercomputing industry then?!?

  60. Other Metrics... by qbed · · Score: 1


    yes, cost...

    --
    imagination is more important than knowledge --Albert Einstein-
  61. Re:Why does a supercomputer need x86 compatibility by Anonymous Coward · · Score: 0

    No. Transmeta chips were chosen because they're low-power, not because they're VLIW. shItaniums are VLIW, but they're certainly not low-power! As it turns out, the code morphing is good, becaue each task can run as efficiently as possible given the data it's being run against.

    aQazaQa

  62. Factor in the cost of the building and AC by Anonymous Coward · · Score: 0

    Supercomputers should include the cost of the building and cooling system needed to house them. Power, heat and size are big factors in this cost. NERSC, LANL, etc have all built new computer centers just to deal with these new systems. These building are just as expensive as the supercomputers themselves. And then you add the recurring costs of the additional staff and maintenance of these centers.

  63. Speaking of G5's and recent price drop by JonnyRo88 · · Score: 1

    The school computer store where I go to school is having to find ways to dump their single processor G5's because of the recent price drop in dual processor 1.8's.

    I think apple might have to buy back some stock or give discounts to retailers. It's pretty vicious to drop down a system that completely obsolete's the retailers stock so soon. Vicious to the retailers at least :).

    I want a G5, but i dont have a place to put it. My wife has officially limited the number of computers to 5.

    --
    The Ro Factor - Jeep/Linux Weblog
    1. Re:Speaking of G5's and recent price drop by Anonymous Coward · · Score: 0

      >I want a G5, but i dont have a place to put it. My wife has officially limited the number of computers to 5.

      Your problem is way too easy. Here's a few solutions (read a-la-Dr.Evil):

      1. A "virus" will "destroy" your slowest/less useful computer

      2. A "power surge" will "explode" the CPU of your slowest/less useful computer

      3. The store offered an "upgrade" for your "now classic, collectable" slowest/less useful computer (might help if it's an old Tandy 1000 or something) ;-)

      Plenty of ways to get that G5 and stay at 5 computers. Heck, here's one more:

      4. If you drop one computer to get the G5, that "G5" will become the "5th" computer in your house. She can't say no to destiny!

      Good luck (hoping your wife is blonde or something)

  64. Well, IBM does have enough clout with S/W shops... by PaulBu · · Score: 1

    Footprint now seems to be measured in "tennis courts" ;-)

    Paul B.

  65. New trend in computing. Vector processing by zymano · · Score: 2, Informative
    1. Re:New trend in computing. Vector processing by DeathPenguin · · Score: 1

      *cough*Earth Simulator*cough*

    2. Re:New trend in computing. Vector processing by zymano · · Score: 1

      i wrote that very fast.

      Yes.

      I meant for the U.S. markets which have shunned it for the general processor.

    3. Re:New trend in computing. Vector processing by ameoba · · Score: 1
      • MMX
      • SSE
      • SSE2
      • AltiVec


      --
      my sig's at the bottom of the page.
  66. Velma?? by Anonymous Coward · · Score: 0
    Hey, what about Velma.

    I couldn't care less about the prissy Daphne. I want a sex story with Velma in it!

  67. Speed is not always best by peawee03 · · Score: 1

    Sure, if one has the budget to build a better supercomputer, like the NCSA, then all one would be interested in is speed. That's great... unless you can't afford it. I am sure that there are many places, like community colleges, small-scale research labs, and other considerably lower-budget places that would greatly appreciate having a supercomputer brought down to a possibly acceptable level. Of course these places would love a top-notch computer, just as you lust at the Ferrari dealership... on your way to the Honda dealership to see about that cute little Civic. Same thing for the smaller institutions. Who cares that your computer is insanely powerful when you can't afford to turn it on? I think that's the aim of the whole efficient supercomputer idea. An OK-speed supercomputer that an institution can afford is better than a powerhouse that it can't.

    --
    I wish I could write clever and witty sigs.
  68. Need a supercomputer to evaluate better materials by Anonymous Coward · · Score: 0

    There has been a lot of research into getting transistors to switch faster. Silicon on insulator systems are used to reduce junction capacitance (and if there is less electrical charge to strip off every time you want to change state, you can do it faster and with less power). I also think the work done with diamonds (see Wired: http://www.wired.com/wired/archive/11.09/diamond_p r.html) on how private researchers and the U.S. Navy are working to produce better semiconductiong materials which can withstand very high thermal loads (silicon on diamond) and building diamonds using chemical vapor deposition. There is also a lot of research using biology to do computing, and on building system-on-chip computing where instead of having a computer with many printed circuit boards (computers of the 80's and 90's) or computers with everything integrated onto the motherboard (today) where sound, network, i/o and processor are all on one motherboard, instead everything is all on one chip (and chips snap together like lego bricks). We need supercomputers to push this along.

  69. Mods? by Anonymous Coward · · Score: 0

    Parent has lots of text, but no numbers.

    Page 4 of the article says that Green Destiny does 11.6 Mflops/watt. This looks like the computing performance of a laptop computer. So have they really done something?

  70. This makes little sense to me by drinkypoo · · Score: 1

    It would seem to make more sense to shut down and start up individual nodes for power saving. A supercomputer has relatively little down time and most of the time jobs come in large batches, you can shut down or heat up additional nodes as needed. It should be relatively easy to implement this kind of power saving inside single "computers" with many processors, and of course absolutely trivial to do it with a cluster. Especially if you use WoL NICs.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    1. Re:This makes little sense to me by Anonymous Coward · · Score: 0

      So you want to run a job on your nice powersaving supercomputer. It is estimated that the job will take about 6 hours to run. You WoL all the computers and find out that 1% is broken. You fix all problems in a couple of hours and WoL again, now a couple of other nodes are broken, so you fix and WoL and fix and WoL, and now everything is running (after working late for two days in a row) and the job is run.

      Most computers break when starting up, especially the disks. That is why you never shut down disk arrays that have been continuously running for over a year. Plus, sleeping computers can't tell you they are broken until you wake then up. And then there are the normal powersaving problems: you don't use the LAN for a couple of minutes, the computer falls asleep although it is calculating it's head off.

      I still think it is possible to do this, but it isn't 'trivial' and it will not give you the kinds of powersaving you get on the desktop (can't spin down the disks for instance).

    2. Re:This makes little sense to me by drinkypoo · · Score: 1

      In some applications, you don't have any disks, though clearly that isn't for everyone. Mostly, if you buy good drives, then you can be sure they will keep starting up. Or, you can buy cheap redundant drives, and RAID everywhere. Or, what I would do, is put all the drives in sleds so when one dies you can just slide another one in.

      You can naturally wake machines up periodically to test their hardware.

      SMART will give you a good idea if many drives are going to fail, before you have shut down and failed to restart.

      And you don't base node shutdown off network activity, you just use the network to start the machines.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  71. Other metrics by carcosa30 · · Score: 1

    "might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?"

    Sure. How fast Quake can run on a Beowulf cluster of them.

    To a lot of people, nothing else matters. Me, I like processing power for its own sake.

    --
    Intolerance for ambiguity is the mark of the authoritarian personality.
  72. Efficiency? by Anonymous Coward · · Score: 1

    No-one seems to have noticed that SGI's R16k CPU uses a grand total of 12W power, and does 1.4 GFLOPs. That's 512 of them for your budget of 5kw. And that's single-system-image, and it'll all fit in 4-5 full racks.

    [yes I work for SGI, but I'm not in marketing.. since marketing never DO anything useful I thought I'd better..]

  73. RTFA dipwad by Anonymous Coward · · Score: 0

    read the freakin article! besides I've been there and I've seen it. it most defintley is drawing commonbuilding power and is not cooled other than the building air. shees RTFA, they say so too

  74. "Fast enough" != "Supercomputer" by blair1q · · Score: 1

    My desktop machine is faster than a Cray 1, and it'll never be labelled "Supercomputer" by any rational being.

    Unless their architecture actually hits the Top Ten, I'm not going to be impressed that it's overcoming its handicap. Unless you're running a Special Olympics for computers and "everyone's a winner."

  75. Blue Gene wins by Anonymous Coward · · Score: 0

    Green Destiny is yesterday's news. Blue Gene, in its baby stage, is slightly smaller and already 25-50 times faster, with only maybe two or three times the power consumption.

  76. Re:Why does a supercomputer need x86 compatibility by Crazy+Eight · · Score: 1

    Well, the parent may have been wondering what I've wondered about Transmeta chips: If they're so efficient at running "morphed" x86 machine code, wouldn't they be even more efficient at running code compiled to its native ISA that didn't need translation?

  77. Green Destiny by Durin00 · · Score: 1

    Li Mu Bai wants his sword back

  78. Finally! by SoTuA · · Score: 1
    This is what Transmeta needs to hype. Their processors are slow, and most people who have laptops plug them into walls 90% of the time, so battery life isn't all that important.

    OTOH, a power-efficient, low-heat cluster with a cooling system that doesn't cost more than the machines that make the cluster is nothing to laugh at. Buy a transmeta-based cluster and you don't need a special contract with the electricity company! You don't need five-feet-thick walls for sound insulation! You don't need to pipe liquid nitrogen to your supercomputer!

  79. Re:Why does a supercomputer need x86 compatibility by joto · · Score: 1
    I've wondered about Transmeta chips: If they're so efficient at running "morphed" x86 machine code, wouldn't they be even more efficient at running code compiled to its native ISA that didn't need translation?

    Probably, if you have an optimizing compiler for exactly that chip. On the other hand, the code-morphing engine is already quite efficient, and by keeping the internal ISA "hidden" or "secret", each new model can have a completely new ISA, and they never have to worry about backwards compatibility.

    By the way, every x86 CPU since the pentium has had their own "internal" instruction set, where x86 instructions was translated into the internal ISA before being executed. None of these, except an early Cyrix pentium clone gave you access to their internal ISA, for much the same reasons as mentioned above. Transmeta's code-morphing just works on a larger scale than individual instructions.

  80. It's what we lose sight of by PurpleWizard · · Score: 1
    Enough computing power is the right amount to do the job require.

    Yes it's a statement of the obvious but I'm amongst what I suspect is the majority that loves the idea of having a multi 64 bit CPU as soon as I have spare cash.

    I don't need that amount of power. The reality is my 700 Duron is still adequate though not totally adequate.

  81. Re:Try Microsoft Valhalla by Anonymous Coward · · Score: 0

    Nice Product

  82. Hmmm. by weierstrass · · Score: 1
    What about the energy in the noise output?

    --
    my password really is 'stinkypants'
    1. Re:Hmmm. by Anonymous Coward · · Score: 0

      sound is cause by vibrations in the air (a form of heat)

    2. Re:Hmmm. by Yartrebo · · Score: 1

      Noise holds VERY little energy. 1 watt per square meter is enough to make you deaf if listened to long enough, and is 120 dB on the decibel scale (insanely loud).

      The average computer puts out well under 1 mW (~80 dB with the box a metre away), and that would be one noisy box.

  83. StrongARM by Tune · · Score: 1

    If MIPS/Watt is the focus, why not use Intel's StrongARM, XScale or other ARM based cores rather than Transmeta's stuff. Afterall, ARM was designed specifically with the MIPS/Watt ratio as objective, starting a whole new architecture from scratch. Whereas Transmeta has focussed on effectient x86 "emulation".

    --
    Real computer scientists despise the idea of actual hardware.
    Hardware has limitations, software doesn't.
    It's a real shame that Turing machines are so poor at I/O.

    1. Re:StrongARM by Bram+Stolk · · Score: 1

      StrongARM has no FPU.
      This means that it is of no use for scientific
      computing.

      Bram

      --
      Bram Stolk http://stolk.org/tlctc/
    2. Re:StrongARM by Tune · · Score: 1

      Arguibly, ARM is weak in math. The original ARM cores indeed do not feature any floating point facilities, but there have always been facilities for IEEE754 floating point in the architecture. Indeed, there are hardware implementations in the form of co processors and software emulation.

      The only reason FPUs were not integrated in StrongARM is that there cost (in terms of Watts) is not justified by the small benefit to performance (in terms of MIPS/FLOPS). Aparently, FPUs, in their current form only make sense for lack of anything better.

  84. Judging a supercomputer by Anonymous Coward · · Score: 0
    In the ideal world, important metrics would include:
    • programmability and debugability (how easy/hard it is to write and/or debug programs on the supercomputer)
    • portability (how easy is it to port programs to/from the supercomputer)
    • applicability (how wide a range of problems can be solved more easily than with alternative systems)
    • adherence to standards (e.g. compatibility with IEEE 754 binary floating point arithmetic standard)
    • peak performance (what is the "guaranteed not to exceed" speed of the system)
    • easily obtained performance (what do you get without having to try too hard)
    • typical performance (what can you realistically expect to achieve)
    Of course, we don't live in an ideal world.

    In the real world, the only metric that matters is how fast the system solves the problem or problems which are important to the person paying the bills. Supercomputers are, by definition, used to solve BIG problems. Nobody really cares how hard it is to implement or debug the program as long as the program runs REALLY fast once it is working (this is a bit of an exaggeration but not as much as you might think). The reason is quite simple - compared to the time that the typical production supercomputing application will consume, the time required to implement/port/debug the program is, for all practical purposes, irrelevant.

    That said, writing high performance software is hard enough without having to screw around with message passing, and/or shared memory/semaphores. Folks have proposed (and companies have been born and died trying to implement/sell) tools/technologies which make writing high performance software easier. They, basically without exception, fail because the marketplace values performance so much more than ease-of-use that they are simply not prepared to trade off even a few percentage points of performance for any meaningful improvements in ease-of-use. This was true back in the 1980s and is still true today. A consequence of this is that today's state of the art (e.g. OpenMP and MPI) are little more than "standardized" versions of the tools which were in common use twenty years ago.

    P.S. This is the "voice of experience" talking as I've been involved in the supercomputing industry on and off for the past twenty years. The opinions expressed above should probably be nuanced a bit but, hey, this is Slashdot and I'm already way WAY over my word limit!
    P.P.S. Peak performance really is the "guaranteed not to exceed" speed of the system. Basically, when the vendor quotes you peak performance numbers, they are telling you that "no matter what you do, the computer will not go any faster than that". They are NOT telling you anything even remotely useful regarding how fast the computer will go when running your application. The gap between peak performance and typical performance can be and often is VERY wide.

  85. Cost by justin_saunders · · Score: 1

    Surely it just boils down to cost.

    Power costs money and so does cooling. A more efficient supercomputer will be cheaper to run.If you can afford to supply your supercomputer with the cooling requirements of a nuclear reactor, fine.

    People tend to focus on the initial outlay for a big system, forgetting that (like a car) it will have ongoing running costs.

    --

    "My cat's breath smells like cat food." - The Tao of Ralph Wiggum.
  86. Power Efficiency by akuma(x86) · · Score: 1

    This is a metric that could be used. How much performance can you get per watt?

    For supercomputing, I would imagine that something like SPECfp/watt or SPECrate/watt would be a decent metric.

    If your limitation is a finite power budget, then you pick the most highest perf/watt CPUs.

    P4 3.2 EE = 18.44 SPECfp/Watt (80 watts)
    Crusoe = ?? No performance numbers published, but I'll bet you it's lower

    Building larger caches (which can be made low power) is a good way to acheive high power/performance efficiency. Crippling your performance with a VLIW seems like a bad choice. You can voltage scale down a Pentium-M to the power levels of a Crusoe and easily get 2-3x the performance.

  87. Re:Why does a supercomputer need x86 compatibility by clacke · · Score: 1
    It's not the only advantage. The morph is not only used for x86 emulation, it also replaces 75% of the hardware compared to any similar processor.

    Using a specialized instruction set would probably be more efficient but, sadly, Transmeta doesn't have enough influence to pull of something like that - they need the compatibility.

  88. Duh by Junks+Jerzey · · Score: 1

    The article offers up this question: might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    Not to sound flippant, but...duh. Okay, I know I sound flippant. But seriously, why has it taken so long to realize that processing speed is not of the utmost importance? It's like saying one car is better than another because has a top speed of 180MPH and the other 174MPH, ignore that the "slower" car gets 30% better mileage. There's such a thing as total cost of ownership.

    Now if only Slashdotters would realize that this applies to home systems and not just supercomputers.

  89. That is all fine and good, until.... by gosand · · Score: 1

    Yeah, just wait until Li Mu Bai finds out, he is going to be pissed.

    --

    My beliefs do not require that you agree with them.

  90. Embedded systems have always... by fitten · · Score: 1

    The article offers up this question: might there be other metrics that might be important to supercomputing, rather than relying solely on processing speed?

    Embedded systems (and I'm not just talking about microcontrollers in your phones or microwaves - I'm talking about 100s of processors connected together in VME cages and the like - see Mercury, CSPI, Sky for examples) have always had the metrics FLOPS/W (FLOPS per Watt) and FLOPS/m^3 (FLOPS per volume) metrics. These were critical measurements because applications required certain performance and the machines themselves had to meet size/weight requirements depending on where they were being deployed. Jamming many processors in the space of a microwave oven to meet performance requirements (like 64+ processors), being less than a certain weight, having power consumption constraints, and requiring high performance without melting down because of the heat has always been an issue in certain sectors.

    In the past, the embedded systems were typically special purpose - ran "special" OSs and were basically big set-top boxes that did only the one thing they were programmed to do. However, a few years back (like 5+), companies like CSPI started doing things like running Linux (or a realtime Linux variant) on their nodes instead of VxWorks and such, turning the box into a general purpose machine. I guess it just takes a while for some things to get enough attention to where someone would post it on /.

  91. The only problem... by An'Desha+Danin · · Score: 0, Troll

    The sole unfortunate drawback of this highly efficient supercomputer is that it can only be properly wielded by Chow Yun Fat.

    --
    Anything you might ever need to say about anything has already been said better by Penny Arcade.
  92. Blue Gene Lite is cooler by jratt · · Score: 1

    The Blue Gene Lite system by IBM is actually running even cooler (article).

    The 440PPC processor being used is designed for embedded computing, so each node (2 processors and 4 FPUs) uses only 15 watts per node. That means that the 1024 processor system (512 nodes in normal configuration), now at #73 in top500, only uses about 7.7kW of power. At 240 processors or 120 nodes, power consumption would only be 1.8kW. This is far better than the Transmeta numbers.

  93. Re:Cars v computers by anactofgod · · Score: 1

    Umm..there was *never* a time when the primary consideration the John Q Public had wrt the purchase of a car was cubic inches and horsepower. That was only true for a small subset of hot rodders and street racers, and is still primarily true for that niche.

    Style, passenger comfort, features, etc. have always been part of the equation, even going back to the earliest days of the automobile. Evidence: Remember that Ford's Model T was available in "any color you want, so long as it's black"? Well, holding on to that sort of thinking opened the door for other companies to eat into Ford's dominant market share, and eventually let the GM companies supplant Ford as the #1 producer of cars. And Ford has yet to reclaim the top spot back.

    What has changed is the consumer added fuel economy and safety to the list of things they consider when purchasing a car. Fuel economy only became a consideration due to outside market forces (the price of petroleum in the '70s), and safety was due to consumer advocacy (Ralph Nader's "Unsafe at Any Speed" testimony), as well as some pressue from the insurance agencies.

    Computer manufacturers are operating under similar market forces. Power consumption, die size and noisey fans fall far short on John Q. Public's list of considerations when purchasing a computer. I'd say at the top of the list, in no particular order, is cost of acquisition, cost of transition (compatibility), and perceived speed. The only time power consumption/efficiency becomes a factor is when one is purchasing laptops, and that metric is only reported as "battery life", which doesn't really capture power consumption/efficiency.

    Even large companies, purchasing electricity to operate hundred/thousands/tens of thousands of computers 24/7, frequently fail to consider whether their computers are "green". No. It's not until the price of electricity becomes a significant line item on someone's bottom line, that anyone really considers efficiency as an important feature to track on a decision making matrix.

    ---anactofgod---

    --

    ---anactofgod---

    "Equal opportunity swindling - *that* is the true test of a sustainable democracy."
  94. They modified the code morphing software? by Thag · · Score: 1
    Although the Transmeta processor is significantly more reliable than a conventional mobile processor, its Achilles' heel is its floating-point performance. Consequently, we modified the CMS to create a "high-performance CMS" that improves floating-point performance by nearly 50 percent and ultimately matches the performance of the conventional mobile processor on a clock-cycle-by-clock-cycle basis.

    That's not exactly trivial. Does anyone know wnything more about this? What are the trade-offs?
    And, will this code will be made available to the general public? I imagine there are Transmeta owners that would also like to double their floating point performance.

    Jon Acheson
    --
    All opinions expressed herein are my own, and not those of my employers, who are appalled.
  95. Re:Old age question - what? Your supercomputer is by Roadkills-R-Us · · Score: 1

    Your basic premise - ``time was the only thing many people would look at is cubic inches or horsepower'' - is flawed. This refers only to a subset of epople who were interested in muscle cars, hot rods, or the term du jour. It's as true today of such people as it was then.

    Muscle cars are the better metaphor for supercomputers; the term "car" just compares to "computer", or at best "individual's computer".

    A hot rod or muscle car is rated in terms of horsepower and torque, or acceleration and speed. In other words, sheer performance. If it's more of a racing vehicle, throw in handling. Evetrything else falls by the wayside - comfort, fuel efficiency, etc. Well, style matters to lots of folks.

    So if your metaphor has much validity, then the only things that matter with supercomputers are performance, and in some cases style. And that about covers where things are today, doesn't it?

    I'm not saying that energy efficiency shouldn't matter in supercomputers. Just that you didn't qiote make your case. 8^)

  96. That's China for you... by Anonymous Coward · · Score: 0

    Little did we know that that blade was actually a blade server. Yet another scientific first for China :)

  97. LAST POST! by Anonymous Coward · · Score: 0

    QED