Slashdot Mirror


Half-Petaflop Supercomputer Deployed In Austin

SethJohnson writes "Thanks to a $59 million National Science Foundation grant, there's likely to be a new king of the High Performance Computing Top 500 list. The contender is Ranger, a 15,744 Quad-Core AMD Opteron behemoth built by Sun and hosted at the University of Texas. Its peak processing power of 504 teraflops will be shared among over 500 researchers working across the even larger TeraGrid system. Although its expected lifespan is just four years, Ranger will provide 500 million processor hours to projects attempting to address societal grand challenges such as global climate change, water resource management, new energy sources, natural disasters, new materials and manufacturing processes, tissue and organ engineering, patient-specific medical therapies, and drug design."

130 comments

  1. Now We Know by Nom+du+Keyboard · · Score: 5, Funny

    So now we know why there is such a shortage of quad-core AMD Opterons otherwise.

    --
    "It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
    1. Re:Now We Know by Chris+Snook · · Score: 2, Insightful

      If I had mod points, I'd mod this insightful, not funny. There are a lot of HPC projects that were planning to use Barcelona, that were held back by the TLB bug. I'm sure anything approaching this magnitude already had a contract with AMD that includes guaranteed delivery dates and penalties, either directly or through the OEM. If you don't have a signed contract with AMD or with someone who has one with AMD, you're going to have to wait in line.

      --
      There's no failure quite as dissatisfying as a complete and total solution to the wrong problem.
    2. Re:Now We Know by Anonymous Coward · · Score: 0

      well, i've worked on the machines where they make these things. I figure that 15744 cores can be dumped out in under a week, worst case. Shortage? not likely.
      300mm^2/wafer * 1chip/400m^2 = ~175chip/wafer
      175chip/wafer * 20% yield = 35chip/wafer (20% yield is generous)
      10min/process_step * 6 process_step/wafer = 1hour/wafer (this is the amount of time they spend on my tool, and my tool is busy ~50% of the time, see next line)
      1hour/wafer * 50% tool utilization = 2tool-hour/wafer
      2tool-hour/wafer / 8 tools = .25hour/wafer
      wafer/.25hour * 35chip/wafer = 140chip/hour
      15744chip / 140chip/hour = 4.68days

    3. Re:Now We Know by edsousa · · Score: 1

      I'm sure anything approaching this magnitude already had a contract with AMD that includes guaranteed delivery dates and penalties They had and wasn't met! Ranger was scheduled to be ready for inclusion in Top500 list released on November 15th.
    4. Re:Now We Know by Anonymous Coward · · Score: 0

      There are a lot of HPC projects that were planning to use Barcelona, that were held back by the TLB bug.


      An HPCWire article says Ranger uses the processors with the TLB bug, and reportedly it doesn't impact their application performance.

      Developed by Sun Microsystems, Ranger was built from 3,936 Constellation blade servers, each containing four quad-core "Barcelona" Opterons running at 2.0 GHz. The 15,744 Barcelona processors in Ranger come from the batch that suffers from the highly publicized translation lookaside buffer (TLB) problem. TACC has used the recommended Linux kernel memory patch to work around that particular problem. Reportedly, the patch has little, if any, impact on performance.


      Ranger was apparently one of the "specific customer deals" that continued to receive Barcelona chips after the erratum was discovered.

      ...spokesman Phil Hughes said AMD is shipping Barcelona Opterons now, but only for "specific customer deals." Industry sources have suggested to TR that those deals are high-volume situations involving supercomputing clusters. Such customers may run workloads less likely to be affected by any workarounds for the erratum that reduce L3 cache performance, and those customers could potentially consume hundreds of thousands of CPUs.


      (Since the workaround BIOS patch slows some cache misses, maybe this means (a) HPC codes with large datasets are long running programs that can be and have been optimized to avoid idling CPU cycles while waiting for memory in cache misses by using techniques like cache prefetching hints or hyperthreading, and (b) the rest have small datasets so that with so many processors the dataset fits in all their caches?)

  2. I've heard this computer is so fast by Anonymous Coward · · Score: 2, Funny

    that it completes an infinite loop in only 5 seconds!

    1. Re:I've heard this computer is so fast by grayshirtninja · · Score: 3, Funny

      Finally! A computer that can run Crysis with full graphics!

    2. Re:I've heard this computer is so fast by The+Master+Control+P · · Score: 1

      Holy shit, you mean it can solve the halting problem for Turing machines? Awesome!

    3. Re:I've heard this computer is so fast by BosstonesOwn · · Score: 3, Funny

      Bahh Crysis is old school.

      Finally TUX RACER in FULL 3D GLORY !

      --
      This package Does Not Contain a Winner
  3. Imagine... by Helix666 · · Score: 0, Redundant

    a beowolf cluster of those...

    --
    Oh, the irony... "Anonymous Coward: If you have nothing to hide, you have nothing to fear!"
    1. Re:Imagine... by Toe,+The · · Score: 3, Funny

      (Score:0, Redundant)

      Yeah, I suppose a cluster is redundant.

  4. Apostrophes by gardyloo · · Score: 3, Funny

    Perhaps it can run spell- and grammar-checks on Slashdot submissions!

    1. Re:Apostrophes by Jeff+DeMaagd · · Score: 1

      How many supercomputers would be needed to spell check for a million monkeys?

    2. Re:Apostrophes by RedWizzard · · Score: 1

      It's peak processing power of 504 teraflops will be shared among over 500 researchers working across the even larger TeraGrid system. Although its expected lifespan is just four years ... What I don't understand is how the editor could it wrong and then in very next sentence get it right. Do the Slashdot editors just toss a coin to see if they should use an apostrophe?
    3. Re:Apostrophes by somersault · · Score: 2, Funny

      There's a lot of variables here. Sadly I've just spent the last 5-10 minutes of my life considering them all and was writing up a post about it. Then I realised that sometimes, I take jokes waaaaay too seriously.

      --
      which is totally what she said
    4. Re:Apostrophes by thx1138_az · · Score: 1

      According to this Fox News story that broke only few days ago even this massive super computer can't handle apostrophes.

    5. Re:Apostrophes by Anonymous Coward · · Score: 0

      I am sure it could do that and more. Word has it that Vista almost runs properly on it.

    6. Re:Apostrophes by pentalive · · Score: 1

      Sadly I've just spent the last 5-10 minutes of my life considering them I would have thought there were better things to think of in the last 5 minutes of your life...

    7. Re:Apostrophes by somersault · · Score: 1

      You would think that.. but it turns out that there aren't!

      --
      which is totally what she said
  5. What was that? by djupedal · · Score: 2, Funny
    Ranger will provide 500 million processor hours to projects attempting to address societal grand challenges such as:
    • global climate change - btdt
    • water resource management - nimby
    • new energy sources - boring
    • natural disasters - omg!
    • new materials and manufacturing processes - yesterday
    • tissue and organ engineering - day before yesterday
    • patient-specific medical therapies - yeah, right...when pigs fly
    • ...and
    • drug design - Well! Hello! In that case, count me in and please proceed!
  6. What does a CPU and Britney Spears have in common? by Jugalator · · Score: 4, Funny

    A: The more flops, the more powerful it grows.

    --
    Beware: In C++, your friends can see your privates!
  7. 4 years is it's lifecycle? SKYNET?!?! by zyzzx0 · · Score: 0

    Is that the year it's name changes to SkyNet and launches a world-wide attack? (me, a pro-scientific-singularitist, trying to be funny).

  8. AMD by milsoRgen · · Score: 4, Interesting

    I'm glad to see AMD based projects like this, as they have certainly took a hit in the HPC space as of late.

    --
    I'm sick of following my dreams. I'm just going to ask where they're goin' and hook up with 'em later.
  9. amd chips? by Anonymous Coward · · Score: 0

    lets hope those TLB's don't go all wonky :P

    1. Re:amd chips? by click2005 · · Score: 1

      It uses Opterons not Phenoms

      --
      I am a free slashdotter. I will not be modded, blogged, DRM'd, patented, podcasted or RFID'd. My life is my own.
  10. The chickens come home to roost by inviolet · · Score: 0, Flamebait

    Ranger will provide 500 million processor hours to projects attempting to address societal grand challenges such as global climate change, water resource management, new energy sources, natural disasters, new materials and manufacturing processes, tissue and organ engineering, patient-specific medical therapies, and drug design."

    ATTENTION RESEARCHERS:

    Processing time on the new Ranger supercomputer is limited, and will be allocated to projects according to merit. Projects that aim to reinforce the current Doctrine naturally have greater merit. Projects that challenge the Doctrine, or that aim to refute it, will be placed in the secondary queue, and will receive an allocation of resources if and when the primary queue is empty.

    In answer to the obvious objection: The University of Texas is a Public institution, and the Ranger supercomputer was built with Public funds, and so it is only appropriate that Ranger's resource allocation mirrors Public opinion. The Public does not like cognitive dissonance, and neither does the board of Regents.

    --
    FATMOUSE + YOU = FATMOUSE
    1. Re:The chickens come home to roost by CookieOfFortune · · Score: 3, Funny

      Doesn't like cognitive dissonance? Have you ever _BEEN_ to Austin?!

    2. Re:The chickens come home to roost by Perseid · · Score: 1

      So my petition for a few days of Crysis is a...no then? Phooey.

    3. Re:The chickens come home to roost by Anonymous Coward · · Score: 1, Insightful

      Yes. This is how science works. What you and your whiny brethren call "doctrine", scientists tend to call "Accepted theories". You have always, and will always, have to argue a whole lot more if you're on the other team. You have a whole lot of people to convince, for a start.

      Who should get precedence: a medical researcher who is trying to prove that HIV does not cause AIDS, or a biological chemist who is looking for a cure for cancer?

      Besides which, the text says "global climate change", not "proving global warming".

  11. Four Years? by dreamchaser · · Score: 1, Funny

    What, is it an android from Blade Runner? It's going to die in four years? Slashdot summaries are the Suxx0rs!

    1. Re:Four Years? by aktzin · · Score: 1

      What, is it an android from Blade Runner?

      I think you mean replicants. Androids, like Lt. Commander Data from Star Trek, have practically unlimited lifespans.

      --
      Quantum mechanics: the dreams that stuff is made of.
    2. Re:Four Years? by Lally+Singh · · Score: 1

      Nope, but I'll be scanning ebay in 2012! Daddy needs some Distributed.Net action!

      --
      Care about electronic freedom? Consider donating to the EFF!
    3. Re:Four Years? by thx1138_az · · Score: 1

      I think the word android can be used since the book (by Philip K. Dick, 1968) that the movie Blade Runner was based upon was titled Do Androids Dream of Electric Sheep?.

  12. Half-computer by SEWilco · · Score: 2, Funny

    And the other half is deployed in Dallas?

  13. Is it ground shaking? by Toe,+The · · Score: 0

    It's nice to know we're that much closer to skynet, but... won't there always be a faster computer?

    I think more shocking news would be "No supercomputing records beat this year!" But I suppose that would just be fiction.

    1. Re:Is it ground shaking? by Anonymous Coward · · Score: 1, Informative

      There already is a faster computer. Ranger's peak is over 90 TF slower than BG/L at LLNL so unless there are some amazing efficiency breakthroughs (doubtful), it isn't going to be number one in June. That, of course, doesn't mean BG/L will still be number one either.

  14. 500M "Processor Hours"? by id10ts · · Score: 1

    (15,744 processors) * (4 cores/processor) * (24 hours/day) * (365 days/year) * (4 years) = 2,206,679,040 core hours

    Seems like the "processor hours" metric needs some adjustment to account for multi-core. Otherwise I could build one of these with 15,744 single-core processors and claim the same performance.

    1. Re:500M "Processor Hours"? by DeftPunk79 · · Score: 1

      It is donating 500M hours to research. Article never says how many total hours are available.

    2. Re:500M "Processor Hours"? by Anonymous Coward · · Score: 1, Interesting

      ...How is this different from a regular supercomputer? Supercomputers are already parallel - this just adds a second layer of parallelism. Competing supercomputers have always had different economy on a "processor hour", multicore CPUs is just one technique to increase the processing power of the machine.

      And you could *TRY* to build a 15,744 single core machine and claim the same performance, but it would all fall apart very very quickly when someone asks "how many FLOPS?" (which is what computing power should be measured in, regardless of how many cores it has).

    3. Re:500M "Processor Hours"? by Anonymous Coward · · Score: 2, Funny

      The rest are going to SETI@home

    4. Re:500M "Processor Hours"? by ozmanjusri · · Score: 1

      Running Vista Ultimate...

      --
      "I've got more toys than Teruhisa Kitahara."
    5. Re:500M "Processor Hours"? by tomhudson · · Score: 1

      The rest are going to SETI@home

      ... as long as its not using SETI@home so it can "phone home".

      How come nobody's pointed out how many PlayStation 3 computer clusters this is?

    6. Re:500M "Processor Hours"? by Anonymous Coward · · Score: 0

      (15,744 processors) * (4 cores/processor) * (24 hours/day) * (365 days/year) * (4 years) = 2,206,679,040 core hours
      (15,744 processors) * (4 cores/processor) * (24 hours/day) * (365.25 days/year) * (4 years) = 2,208,190,464 compute hours.

      Although I wonder how many hours will be lost to configure the system, performance tuning, etc.
    7. Re:500M "Processor Hours"? by EvanED · · Score: 2, Insightful

      Seems like the "processor hours" metric needs some adjustment to account for multi-core. Otherwise I could build one of these with 15,744 single-core processors and claim the same performance.

      Why are you associating processor-hours with performance anyway? You could hook up 15,744 286s and get the same number of processor-hours too. So why don't you complain about that?

    8. Re:500M "Processor Hours"? by Anonymous Coward · · Score: 0

      The current area of research in supercomputing seems to be making the theoretical peak processing speed the guaranteed processing speed. When you have 15,744 processors, your main problem now becomes feeding the data in and out of the system. For example, if you are doing a visualisation of future weather patterns, you need to be to read in the initial state of the simulation, store the current state of your weather system, the next state of your weather system, while at the same time sending the data out to a workstation to be rendered.
      All of this is going to need ultra high speed storage (RAID arrays) and networks.

  15. Can't they do better than nnnn-"flop"? by tomhudson · · Score: 1, Funny

    Gee, this computer is the BIGGEST flop generator of them all!

    That's too bad.

    NO! That's GOOD!

    It is?

    Yeah, lots and lots of flops per second - the more the better!

    So the bigger the flops, the better?

    Right!

    Fewer flops is bad?

    You got it!

    And researchers want more money for more time with bigger flops?

    Now you get it!

    So they got $59 million for this humongous flop generator?

    Yep!

    Why don't they just burn the money if they want to generate a really big flop?

    That wouldn't work - that wouldn't make any useful computing flops!

    So this generates all these "useful computing flops"

    Yes.

    Was Vista one of their prototypes?

    1. Re:Can't they do better than nnnn-"flop"? by somersault · · Score: 1

      Sure they can do better than flops - you ever hear about those megaflops? They're even bigger than normal flops.

      --
      which is totally what she said
    2. Re:Can't they do better than nnnn-"flop"? by Plaid+Phantom · · Score: 1

      Third base!

      I know, it's not the same thing. Still, it seemed fitting.

      --
      All comments are properties and trademarks of the voices in my head. Not like I'm gonna claim them.
  16. 4 year lifespan by DeftPunk79 · · Score: 5, Interesting

    The 4 year lifespan in the /. article refers to the amount of time the award money covers for operations costs. So if it finds some others mean s of operation funds it could live longer... of course those funds will probably be from a private organization and the ranger would no longer be open for research.

    1. Re:4 year lifespan by pimpimpim · · Score: 2, Insightful

      Within four years the Performance/Watt ratio will have dropped compared to state of the art, so it would make very little sense to keep the thing taking valuable computer room space and working hours of the technical staff. It happens with all supercomputing machines, just Moore's law in practice. What I think is still a big problem is that there are still many problems getting the hardware work correctly in parallel. Often half a year or longer is lost debugging file system/network issues, which is a considerable time compared to the total effective lifespan. With all the multicores in the making, a sturdy parallel computing implementation is very much needed!

      --
      molmod.com - computing tips from a molecular modeling
    2. Re:4 year lifespan by Anonymous Coward · · Score: 0

      Often half a year or longer is lost debugging file system/network issues, which is a considerable time compared to the total effective lifespan.

      Sadly, that's very true, as TACC is still debugging file system issues on the previous supercomputer, Lonestar.

    3. Re:4 year lifespan by pimpimpim · · Score: 1
      Well, I was talking out of personal experience ;) Not at TACC, though. Debugging such issues on these systems is always very difficult. There are a lot of users, all have different programs and it might be just a bug in the user's program. And then there are a lot of incompatibilities between several compilers and network systems (infiniband, etc).

      I guess the field is just too fast-moving to force some hardware/software standards on it, but its bugginess does cost a lot of money and computing time, and since parallel computing is the way to go, something has to be done.

      --
      molmod.com - computing tips from a molecular modeling
  17. are you serious? by MrMaverick092588 · · Score: 1

    freaking lame, 59 million dollars... i go to UT, and if this means no more free condoms then we're gonna have words.

    1. Re:are you serious? by chillax137 · · Score: 3, Funny

      Just grab a few and you'll be set for the next four years...

      Seriously though, this money comes from an NSF grant earmarked specifically for this project. We get these kind of complaints from other departments and especially undergrad editorials in the student newspaper. Unfortunately, the budget from the football team won't be used to renovate the social work buildings.

      --
      chillax137
    2. Re:are you serious? by LilGuy · · Score: 1

      Do what most other slashdotters do... use a paper towel or a sock.

      --

      You're nothing; like me.
  18. The one advantage they may enjoy.. by Junta · · Score: 1

    Couldn't see details, but this may use Sun's hypertransport switch as an interconnect. Until Intel's next generation of chips with QPI, you couldn't do that sort of interconnect with Intel processors. Admittedly though, I'm not convinced that it is significant enough a benefit over recent Infiniband solutions despite the penalty of going through an Infiniband chip and then a PCI express controller.

    Even with the L3 errata straightened out, it still looks to be a rough road for AMD, who hasn't demonstrated clock-for-clock performance up to Core 2 yet, and also has lower clock speeds to boot. Unless AMD pulls something dramatic, it will be hard to justify AMD in supercomputing once Intel goes to QPI. They can pull off price-performance tricks to some extent, but in large deployments the power/cooling penalty is non-trivial.

    --
    XML is like violence. If it doesn't solve the problem, use more.
    1. Re:The one advantage they may enjoy.. by Wesley+Felter · · Score: 2, Informative

      Couldn't see details, but this may use Sun's hypertransport switch as an interconnect. Sun doesn't make a Hypertransport switch and Ranger uses Infiniband just like other high-end x86 clusters.
    2. Re:The one advantage they may enjoy.. by afidel · · Score: 1

      Power and cooling penalties? Are you looking at the same spec sheets I am because I'm seeing better performance per Watt out of Barcelona systems than out of Intel quad core Xeon's based systems. Most of it has to do with the fact that Intel uses power sucking FB-Dimms, but that's a design tradeoff that Intel made.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    3. Re:The one advantage they may enjoy.. by Anonymous Coward · · Score: 0

      Couldn't see details, but this may use Sun's hypertransport switch as an interconnect. Sun doesn't make a Hypertransport switch and Ranger uses Infiniband just like other high-end x86 clusters.

      An HPCWire article says it uses Sun's new 'Magnum' Infiniband switch.

      The blade servers are connected using two Sun DDR InfiniBand "Magnum" switches, which were designed specifically for the highly scaled out cluster architecture of the Constellation line. The switch contains 3,456 ports, allowing the Sun system designers to collapse the hierarchy of switches and reduce the cabling normally required to connect thousands of nodes by a factor of six.


  19. Global climate change, new energy sources... by Tmack · · Score: 4, Funny

    attempting to address societal grand challenges such as global climate change, water resource management, new energy sources..

    With that many cores, they will need to find new energy sources just to power it, and re-think water resource management as they redirect the river to cool the thing and to prevent it from causing global climate change itself!

    Tm

    --
    Support TBI Research: http://www.raisinhope.org
    1. Re:Global climate change, new energy sources... by Statecraftsman · · Score: 1

      Yes, it's going to use some power...but I would compare this to teaching a man how to fish rather than handing him one. This energy will be an investment in all sorts of efficiencies in the future. That is, if the computing time is allocated efficiently.

    2. Re:Global climate change, new energy sources... by adrianmonk · · Score: 2, Informative

      With that many cores, they will need to find new energy sources just to power it,

      Luckily, UT has its own power plant.

    3. Re:Global climate change, new energy sources... by Hillgiant · · Score: 1

      Actually UT Austin has its own natural gas fired power plant. As of 12 years ago, it made enough power to sell excess back to the city. It also had a fairly impressive uptime with only one black out during its entire operational lifetime. Unless the power requirements for UT have grown out of control (there has been A LOT of construction since I graduated), I suspect that there will be little trouble running the computer cluster.

      --
      -
  20. And? by Junta · · Score: 4, Informative

    Both Opteron and Phenom were at the same B2 stepping, complete with the same L3 errata, despite the different packaging. That's why you haven't seen a Tier one vendor touch the Opterons with a 10 foot poll for a generally available product. You can bet your ass this is the reason AMD released the kernel patch so 'some customer' could proceed with a Linux Opteron deployment with B2 parts without the performance penalty nor risk of the L3 errata.

    This deployment is probably where AMD focused a firesale of B2 parts, since it's nice and well controlled.

    --
    XML is like violence. If it doesn't solve the problem, use more.
    1. Re:And? by Anonymous Coward · · Score: 0

      How many questions do you think fit on a ten foot poll?

    2. Re:And? by somersault · · Score: 1

      a 10 foot poll Some might say that CowboyNeal has way too much time on his hands
      --
      which is totally what she said
  21. Re:4 years is it's lifecycle? SKYNET?!?! by Anonymous Coward · · Score: 4, Funny

    No, it's hoped that within that time you'll learn how to correctly use the apostrophe.

  22. Dell has to be fuming by fabu10u$ · · Score: 2, Interesting

    In their backyard, and Sun gets the job instead. (Maybe this is why Dell has started offering AMD?)

    --
    They say the mind is the first thing to ... uh, what's that saying again?
    1. Re:Dell has to be fuming by tomhudson · · Score: 5, Funny

      "In their backyard, and Sun gets the job instead."

      Do you really want to have a $59M machine dependent upon Dell customer support?

    2. Re:Dell has to be fuming by Temkin · · Score: 1

      In their backyard, and Sun gets the job instead. (Maybe this is why Dell has started offering AMD?) Sun has a reasonably large Austin presence as well. That's where they designed the Niagara processor.

    3. Re:Dell has to be fuming by EXMSFT · · Score: 1

      As does AMD.

    4. Re:Dell has to be fuming by Anonymous Coward · · Score: 0

      Systems this large are usually offered by cray, sun, and other players (sure also dell)

      But if you ask whats this one different from the others I must say that it is in the interconnection network. It uses only 2 SUN (extremely high density) switches called magnum to interconnect the system, and its one of a kind infiniband switch, as described here (among other features with links): http://blogs.sun.com/marchamilton/entry/more_ranger_facts_and_figures

    5. Re:Dell has to be fuming by Hadlock · · Score: 1

      AMD has been trying to build a plant in Austin for years now. This is most likely a deal deeply connected with finally breaking ground on a plant people have been protesting for YEARS now, due to it's location (near watersheds, etc)

      --
      moox. for a new generation.
  23. ...Calculating the global climate change... by Anonymous Coward · · Score: 0

    ...that will be caused by generating enough electricity to power the Ranger to calculate the global climate change that will be caused by generating enough electricity to power the Ranger to calculate the global climate change that will be caused by... etc etc etc...

    Just how much juice will it take to light this sucker up anyway?

  24. Oh the humanity! by plasmacutter · · Score: 1
    a witness to the vandalism is quoted saying..

    It's burst into flames! It burst into flames....It's crashing!....Oh the humanity!....This is the worst thing I've ever witnessed.


    Oh wait, you said deployed, not destroyed..

    carry on
    --
    VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
  25. Biggest Computer? What About a Googleplex? by RudyHartmann · · Score: 1

    Hey. Is a Googleplex ever counted in as one of these big a$$ multi-processor monsters? If not, why? Those suckers are ginormous. R

    --
    Oh, yeah! Wise guy, huh? Woob woob woob woob! Nyuk! Nyuk!
    1. Re:Biggest Computer? What About a Googleplex? by BosstonesOwn · · Score: 1

      I don't think the googleplex shares cycles quite like this.

      I remember reading the infiniband switch main inventor's bio while working at Sun , interesting guy who had these types of things on his mind all the time.

      --
      This package Does Not Contain a Winner
  26. Newspeak by Anonymous Coward · · Score: 0

    Petaflop? Teraflop? Say what? Are these actual terms, and did someone get paid to think them up?

    1. Re:Newspeak by Plaid+Phantom · · Score: 2, Informative
      --
      All comments are properties and trademarks of the voices in my head. Not like I'm gonna claim them.
  27. actually... by elite1789 · · Score: 5, Interesting

    I was at TACC a few weeks ago, and the peak performance was around 519 teraflops.... Sadly, they also said the word on the street is that IBM wont take too kindly to the new king in town, and since TOP500 is biannually, everyone is biting their nails about blue-gene getting a quick upgrade in time to stay on top. Turns out the blue-gene systems are so scalable its quite easy to strap a few thousand new processors for a nice performance boost.

    1. Re:actually... by Anonymous Coward · · Score: 2, Insightful

      BlueGene/L at LLNL already peaks significantly faster than Ranger. The only question is whether Ranger can get a =sustained= number that passes BG/L and considering the difference in peak performance, it's unlikely. June is going to be an interesting list as there could be quite a bit of shuffle at the top.

      You are also correct about the scalability of BG. If you look at last June's list and last November's list you'll see a big difference in performance for BG/L. That's entirely due to simply adding more racks.

    2. Re:actually... by Anonymous Coward · · Score: 0

      Actually, BG/L at LLNL is already at a higher peak: 596.378 TFlops (according to top500).

    3. Re:actually... by Anonymous Coward · · Score: 0

      I was also recently at TACC and they have not yet managed to run an application across the full system, much less run a TOP500 Linpack. They can also stop biting their nails, since the LLNL BG/L system was already at 596 TF peak (with much better Linpack efficiency) in November 2007.

    4. Re:actually... by Anonymous Coward · · Score: 0

      What, IBM actually dares to - gasp! - compete? I'm shocked. Shocked, I say!

  28. Walker Texas Ranger by dpx420 · · Score: 1

    Chuck Norris doesn't need high performance supercomputers, he can threaten any old 486 into running twice as fast.

    1. Re:Walker Texas Ranger by somersault · · Score: 1

      Wowee.. at under 10 MFLOPS that's got to be some beast of a machine! Or do you mean get the 486 running twice as fast as a supercomputer? I don't think we need another sun in this solar system :o

      --
      which is totally what she said
  29. Oblig. by Pieisexaclty3 · · Score: 1

    Imagine a Beowulf cluster of those

  30. Queue the: But Does it run linux? by dustwun · · Score: 2, Informative

    And the answer is apparently yes. According to techtarget.com It'll be running CentOS just like slashdot does.

  31. IMPORTANT MESSAGE FOR kdawson AND SethJohnson! by Anonymous Coward · · Score: 0, Informative

    It's peak processing power

    "Its".

    1. Re:IMPORTANT MESSAGE FOR kdawson AND SethJohnson! by kyriosdelis · · Score: 1

      It's ...Austin Power!

      --
      I don't mind dating a girl that has been with everybody, as long as she had a good shower afterwards.
  32. The truth... by HeLLFiRe1151 · · Score: 1

    Sure they will work on climate calculations.. but first on the agenda is being able to play Crysis in hi-res with all options on.

    --
    I've got 101 mod points and you can't have them!
  33. sure, that sounds great, but... by oliphaunt · · Score: 1

    how many bogomips per petaflop?

    --




    Humpty Dumpty was pushed.
  34. New King? Not! by Anonymous Coward · · Score: 0

    BlueGene/L has a peak of 596 TFLOP and a sustained of 478.2 TFLOP. Ranger would have to get nearly 95% efficiency to tie for #1.

  35. What happens after lifespan? by HockeyPuck · · Score: 2, Interesting

    Ranger comprises 3,936 compute nodes in a Sun Blade(TM) 6048 Modular System with 15,744 Quad-Core AMD Opteron(TM) processors, and Sun Fire(TM) x4500 servers providing 1.7 petabytes of storage. Since TFA says this hardware will last only four years, what typically happens to these supercomputers built out of so called commodity hardware? Is sun going to donate/resell this gear? Or does it end up in the scrap heap? Surely, these Sun Blades are supposed to have a useful lifespan greater than four years. Sun could probably give these blades to every elementary school in all of Texas. Is the future of super computing aka disposable computing?
    1. Re:What happens after lifespan? by Albert+Sandberg · · Score: 3, Interesting

      It's actually the best way to aquire the new AMD Opteron processor, just wait for 4 years and get in line.

    2. Re:What happens after lifespan? by flaming-opus · · Score: 1

      Probably this means that the system is funded for 4 years. About 2 years in, they will try to renew their grants. If they do, they will probably upgrade the system at about 3 years with a mid-life kicker. This would probably be new blades using 8-core opterons and 2-4 times as much memory. They might even get a second kicker if AMD comes out with a socket-compatible upgrade. After that it's probably time for a forklift upgrade.

      This cycle is fairly typical for HPTC systems, and a 6 year total life-span is pretty usual. (Though there seem to be a ton of old origins still out there, for some reason. I don't think the altix has sold well enough to displace all the old irix machines)

      The cost (power, man-hours) of running a big machine like this is pretty high, so you really only run the thing if you can get a lot of billable hours out of it. Some machines stick around for a long time, as there are specific codes that run on them, that aren't easily ported to the successor machine. Since this is just a big linux cluster, the codes can easily be run on the next big linux cluster, so the desire to keep the outdated machine (or part of it) around, is pretty small. That's why you often see a machine room with a huge linux cluster on one end, and a couple of big, but outdated IBM/SUN/SGI/Alpha SMPs at the other end. I remember Cray J90s hanging around WAY past their competitive lifespans, because you could run the old codes from the 80's on them with no modifications. That's not gonna happen for JAXLB (Just Another x86 Linux Box).

  36. More Processors! by robizzle · · Score: 1

    It sounds like they don't need faster super computers but instead to narrow the number of areas they are crunching away at. Why not pick the top 2 or 3 issues and crunch away at those instead of running 20 jobs, all of which will hardly get anywhere in the four years this supercomputer has to live?

    1. Re:More Processors! by Chandon+Seldon · · Score: 1

      They've put quite a bit of thought into how to efficiently allocate time on a 60 million dollar compute cluster, I can assure you. If some jobs get time, it's because non-trivial progress can be made on those things in the time they've been allocated.

      --
      -- The act of censorship is always worse than whatever is being censored. Always.
  37. Re:New King? Not! by mmell · · Score: 1

    Hmmm...you sound like somebody I used to work with.

  38. seti by simontek2 · · Score: 1

    All i could think of is, after 4 years, i am sure the seti, or folding projects would love to have that system. I wouldn't mind it either.

    --
    SimonTek
  39. Political Positioning by Hadlock · · Score: 1

    UT students have been pushing against putting a polluting plant in Austin (very green-aware city) for years. This is just a move to placate the protestors, I'm sure. 4 years? What happens after that?

    --
    moox. for a new generation.
    1. Re:Political Positioning by lowid+(24)+_________ · · Score: 1

      What does this polluting plant have to do with anything? I can't see how they would have decided to build a 59 million dollar supercomputer to placate protesters that were protesting against something completely irrelevant to supercomputers.
      (to answer your question, after 4 years the computer loses public funding, but doesn't cease operation.)

  40. Re:What does a CPU and Britney Spears have in comm by Anonymous Coward · · Score: 0

    Jug-a-lator obviously wants to pet-a-flop later. (.)^(.) =P

  41. Where's the fun in that? by jd · · Score: 1

    Nah. They should donate the spare cycles into running slashdot. Can you imagine how fast the main page could be updated?

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    1. Re:Where's the fun in that? by gardyloo · · Score: 1

      Heck, it could preemptively slashdot the entire internet into submission.

  42. this is the begining by Anonymous Coward · · Score: 0

    this is truly the begining of skynet, as sarah connor predicted.

  43. Rethinking this by PingPongBoy · · Score: 1

    Odd to have a computer of this magnitude only in use for four years, though that might speak of its power inefficiency perhaps in light of new technology in 2012.

    BUT

    The year 2012 is the end of the Mayan calendar. This computer may have been actually assigned to find out what is going to happen in 2012. So it better have the answer in 4 years.

    --
    Know your pads. One time pad: good for cryptography. Two timing pad: where to take your mistress.
  44. Re:4 years is it's lifecycle? SKYNET?!?! by nacturation · · Score: 1

    No, it's hoped that within that time you'll learn how to correctly use the apostrophe. If you're still stuck, listen to Bob!
    --
    Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
  45. Robot-wars by Anonymous Coward · · Score: 0

    Through my semi-conscious hangover blurred vision I read "Half-Petaflop Supercomputer Destroys Austin", the adrenalin rush caused by the potential start of the robot-wars really sorted out my hangover, Cheers.

  46. Does I.T. come in different colors? by redstar427 · · Score: 1

    What if I want a different color than green for my I.T.?

    --
    "Two things are infinite: the universe and human stupidity; and I'm not sure about the universe." Albert Einstein
    1. Re:Does I.T. come in different colors? by Hillgiant · · Score: 1

      IT is also available in red or black and blue.

      --
      -
  47. It's *MUCH* faster than that by mangu · · Score: 3, Interesting
    Here's the source code for an infinite loop:

    int main(){
      int i;
      for (i = 1; i > 0; i++)
    /* do nothing */ ;
      return 0;
    }
    It runs in my 2.4GHz single-CPU computer in five seconds.


    Explanation: this affirmation that "a computer is so fast it runs an infinite loop in X seconds" is actually true. Integers overflow, if you increase the largest positive number you get a negative number. But of course, this program uses 32-bit integers, it would take four billion times longer running in 64 bits.

    1. Re:It's *MUCH* faster than that by MaxShaw · · Score: 2, Insightful
      A loop where the counter can overflow is by definition not infinite. Here's an actual infinite loop for you to try:

      while (true) {
      //Do nothing
      }
      Call me back when your computer finishes this one.
    2. Re:It's *MUCH* faster than that by Anonymous Coward · · Score: 0

      Sorry without including the volatile keyword for i the compiler will just make i=-2^31. And since i isn't used for anything else it will just remove that and just exit the program. Thanks for playing.

    3. Re:It's *MUCH* faster than that by Anonymous Coward · · Score: 0

      What compiler? What machine?

      Specify fully or your attempt to be clever is meaningless. Make that more meaningless.

    4. Re:It's *MUCH* faster than that by Anonymous Coward · · Score: 0
      Goddamn man, that ain't an infinite loop. Try this:

      int main(){
      int i;
      while(1)
      /* do nothing */ ;
      return 0;
      }
    5. Re:It's *MUCH* faster than that by Pla123 · · Score: 1

      Because this is not an infinite loop... Try this: while(true) /* do nothing */ ; Its execution time line is parallel to the time line, but we know parallel lines intersect in infinity... so this computer may actually reach there sooner than expected... ;)

  48. The lifespan is not four years by mangu · · Score: 1

    Four years is not how long the hardware will last, it's how long the $59 million funding for covering operation costs will last. After that they will have to get money from somewhere else.

  49. Several months late... by Anonymous Coward · · Score: 1, Insightful

    Some fraction of this machine was originally supposed to be in production in May of last year (a requirement of the original request for proposals), but as far as I know it wasn't even accessible to friendly users until some time last fall. I don't understand how TACC, Sun, and/or AMD avoided getting hit with penalties from the NSF.

  50. Power and cooling in aggregate, not standalone. by Junta · · Score: 1

    I'm saying in order to get the same number of flops and using price-performance instead of straightforward performance, you must increase node count. If the processor performance/watt *was* better (I believe with the 45 nm process on Intel's side for the moment, a Xeon 2.33 quad core comes in a 50W TDP variant, for example, Barcelona comes in at 95W TDP, goes along way toward offsetting the FB-DIMM power), you still have to worry about more AC power supply inefficiencies, general power usage of extra motherboards, fans, hard drives, etc. I hear Opteron may be able to more effectively reduce power consumption when bits are idle, but if you aren't overbuilding your cluster and will always have jobs in the queue, the goal is to avoid being idle. If utilization of the cluster is consistantly under 90%, you probably overplanned and paid too much.

    The FB-Dimms do suck however. Expensive, power-sucking, and so far only yields none of the promised memory throughput benefit while incurring a significant latency penalty. The only theoretical benefit achieved is that a simpler trace situation is possible (i.e. can scale out memory without a ludicrous trace design requiring many layers), but I haven't seen that leveraged in practice beyond what AMD offerings have scaled to. The other thought put forth is that PCBs could be done with fewer layers with respect to the DIMMs, but I think for other reasons the boards have to have so many layers anyway, so that could be a moot point.

    --
    XML is like violence. If it doesn't solve the problem, use more.
  51. This is great for Australia but... by ihavenospine · · Score: 1

    I wonder if this supercomputer has bandwith caps like most aussies.

    1. Re:This is great for Australia but... by ihavenospine · · Score: 1

      oh wait idiot... is austin not australia.---

  52. So Fast... by pentalive · · Score: 1

    Computing at Ludicrous Speed!

  53. O' Deep Thought by Jehosephat2k · · Score: 1


    From "The Hitchhiker's Guide to the Galaxy" by Douglas Adams

    Chapter 25
    There are of course many problems connected with life, of which some of the most popular are Why are people born? Why do they die? Why do they want to spend so much of the intervening time wearing digital watches?

    Many many millions of years ago a race of hyperintelligent pan- dimensional beings (whose physical manifestation in their own pan-dimensional universe is not dissimilar to our own) got so fed up with the constant bickering about the meaning of life which used to interrupt their favourite pastime of Brockian Ultra Cricket (a curious game which involved suddenly hitting people for no readily apparent reason and then running away) that they decided to sit down and solve their problems once and for all.

    And to this end they built themselves a stupendous super computer which was so amazingly intelligent that even before the data banks had been connected up it had started from I think therefore I am and got as far as the existence of rice pudding and income tax before anyone managed to turn it off.

    It was the size of a small city.

    Its main console was installed in a specially designed executive office, mounted on an enormous executive desk of finest ultramahagony topped with rich ultrared leather. The dark carpeting was discreetly sumptuous, exotic pot plants and tastefully engraved prints of the principal computer programmers and their families were deployed liberally about the room, and stately windows looked out upon a tree-lined public square.

    On the day of the Great On-Turning two soberly dressed programmers with brief cases arrived and were shown discreetly into the office. They were aware that this day they would represent their entire race in its greatest moment, but they conducted themselves calmly and quietly as they seated themselves deferentially before the desk, opened their brief cases and took out their leather-bound notebooks.

    Their names were Lunkwill and Fook.

    For a few moments they sat in respectful silence, then, after exchanging a quiet glance with Fook, Lunkwill leaned forward and touched a small black panel.

    The subtlest of hums indicated that the massive computer was now in total active mode. After a pause it spoke to them in a voice rich resonant and deep.

    It said: "What is this great task for which I, Deep Thought, the second greatest computer in the Universe of Time and Space have been called into existence?" Lunkwill and Fook glanced at each other in surprise.

    "Your task, O Computer ..." began Fook.

    "No, wait a minute, this isn't right," said Lunkwill, worried. "We distinctly designed this computer to be the greatest one ever and we're not making do with second best. Deep Thought," he addressed the computer, "are you not as we designed you to be, the greatest most powerful computer in all time?"

    "I described myself as the second greatest," intoned Deep Thought, "and such I am."

    Another worried look passed between the two programmers. Lunkwill cleared his throat.

    "There must be some mistake," he said, "are you not a greatest computer than the Milliard Gargantubrain which can count all the atoms in a star in a millisecond?"

    "The Milliard Gargantubrain?" said Deep Thought with unconcealed contempt. "A mere abacus - mention it not."

    "And are you not," said Fook leaning anxiously forward, "a greater analyst than the Googleplex Star Thinker in the Seventh Galaxy of Light and Ingenuity which can calculate the trajectory of every single dust particle throughout a five-week Dangrabad Beta sand blizzard?"

    "A five-week sand blizzard?" said Deep Thought haughtily. "You ask this of me who have contemplated the very vectors of the atoms in the Big Bang itself? Molest me not with this pocket calculator stuff."

    The two programmers sat in uncomfortable silence for a moment. Then Lunkwill leaned forward again.

    "But are you not," he said, "a more fiendish disputant than the G

  54. Chapter 26+27 by Jehosephat2k · · Score: 1

    OK, the end of the skit from Hitchhiker's Guide:

    Chapter 26
    "Yes, very salutary," said Arthur, after Slartibartfast had related the salient points of the story to him, "but I don't understand what all this has got to do with the Earth and mice and things."

    "That is but the first half of the story Earthman," said the old man. "If you would care to discover what happened seven and a half millions later, on the great day of the Answer, allow me to invite you to my study where you can experience the events yourself on our Sens-O-Tape records. That is unless you would care to take a quick stroll on the surface of New Earth. It's only half completed I'm afraid - we haven't even finished burying the artificial dinosaur skeletons in the crust yet, then we have the Tertiary and Quarternary Periods of the Cenozoic Era to lay down, and ..."

    "No thank you," said Arthur, "it wouldn't be quite the same."

    "No," said Slartibartfast, "it won't be," and he turned the aircar round and headed back towards the mind-numbing wall.

    Chapter 27
    Slartibartfast's study was a total mess, like the results of an explosion in a public library. The old man frowned as they stepped in.

    "Terribly unfortunate," he said, "a diode blew in one of the life-support computers. When we tried to revive our cleaning staff we discovered they'd been dead for nearly thirty thousand years. Who's going to clear away the bodies, that's what I want to know. Look why don't you sit yourself down over there and let me plug you in?"

    He gestured Arthur towards a chair which looked as if it had been made out of the rib cage of a stegosaurus.

    "It was made out of the rib cage of a stegosaurus," explained the old man as he pottered about fishing bits of wire out from under tottering piles of paper and drawing instruments. "Here," he said, "hold these," and passed a couple of stripped wire end to Arthur.

    The instant he took hold of them a bird flew straight through him.

    He was suspended in mid-air and totally invisible to himself. Beneath him was a pretty treelined city square, and all around it as far as the eye could see were white concrete buildings of airy spacious design but somewhat the worse for wear - many were cracked and stained with rain. Today however the sun was shining, a fresh breeze danced lightly through the trees, and the odd sensation that all the buildings were quietly humming was probably caused by the fact that the square and all the streets around it were thronged with cheerful excited people. Somewhere a band was playing, brightly coloured flags were fluttering in the breeze and the spirit of carnival was in the air.

    Arthur felt extraordinarily lonely stuck up in the air above it all without so much as a body to his name, but before he had time to reflect on this a voice rang out across the square and called for everyone's attention.

    A man standing on a brightly dressed dais before the building which clearly dominated the square was addressing the crowd over a Tannoy.

    "O people waiting in the Shadow of Deep Thought!" he cried out. "Honoured Descendants of Vroomfondel and Majikthise, the Greatest and Most Truly Interesting Pundits the Universe has ever known ... The Time of Waiting is over!"

    Wild cheers broke out amongst the crowd. Flags, streamers and wolf whistles sailed through the air. The narrower streets looked rather like centipedes rolled over on their backs and frantically waving their legs in the air.

    "Seven and a half million years our race has waited for this Great and Hopefully Enlightening Day!" cried the cheer leader. "The Day of the Answer!"

    Hurrahs burst from the ecstatic crowd.

    "Never again," cried the man, "never again will we wake up in the morning and think Who am I? What is my purpose in life? Does it really, cosmically speaking, matter if I don't get up and go to work? For today we will finally learn once and for all the plain and simple answer to all these nagging little problem

  55. Chapter 28 by Jehosephat2k · · Score: 1

    And finally, Chapter 28 to end the story:

    Chapter 28
    It was a long time before anyone spoke.

    Out of the corner of his eye Phouchg could see the sea of tense expectant faces down in the square outside.

    "We're going to get lynched aren't we?" he whispered.

    "It was a tough assignment," said Deep Thought mildly. "Forty-two!" yelled Loonquawl. "Is that all you've got to show for seven and a half million years' work?"

    "I checked it very thoroughly," said the computer, "and that quite definitely is the answer. I think the problem, to be quite honest with you, is that you've never actually known what the question is."

    "But it was the Great Question! The Ultimate Question of Life, the Universe and Everything!" howled Loonquawl.

    "Yes," said Deep Thought with the air of one who suffers fools gladly, "but what actually is it?"

    A slow stupefied silence crept over the men as they stared at the computer and then at each other.

    "Well, you know, it's just Everything ... Everything ..." offered Phouchg weakly.

    "Exactly!" said Deep Thought. "So once you do know what the question actually is, you'll know what the answer means."

    "Oh terrific," muttered Phouchg flinging aside his notebook and wiping away a tiny tear.

    "Look, alright, alright," said Loonquawl, "can you just please tell us the Question?"

    "The Ultimate Question?"

    "Yes!"

    "Of Life, the Universe, and Everything?"

    "Yes!"

    Deep Thought pondered this for a moment.

    "Tricky," he said.

    "But can you do it?" cried Loonquawl.

    Deep Thought pondered this for another long moment.

    Finally: "No," he said firmly.

    Both men collapsed on to their chairs in despair.

    "But I'll tell you who can," said Deep Thought.

    They both looked up sharply.

    "Who?" "Tell us!"

    Suddenly Arthur began to feel his apparently non-existent scalp begin to crawl as he found himself moving slowly but inexorably forward towards the console, but it was only a dramatic zoom on the part of whoever had made the recording he assumed.

    "I speak of none other than the computer that is to come after me," intoned Deep Thought, his voice regaining its accustomed declamatory tones. "A computer whose merest operational parameters I am not worthy to calculate - and yet I will design it for you. A computer which can calculate the Question to the Ultimate Answer, a computer of such infinite and subtle complexity that organic life itself shall form part of its operational matrix. And you yourselves shall take on new forms and go down into the computer to navigate its ten-million-year program! Yes! I shall design this computer for you. And I shall name it also unto you. And it shall be called ... The Earth."

    Phouchg gaped at Deep Thought.

    "What a dull name," he said and great incisions appeared down the length of his body. Loonquawl too suddenly sustained horrific gashed from nowhere. The Computer console blotched and cracked, the walls flickered and crumbled and the room crashed upwards into its own ceiling ...

    Slartibartfast was standing in front of Arthur holding the two wires.

    "End of the tape," he explained.

  56. Re:Oblig. ... Part 2 ... by The+Sith+Lord · · Score: 1

    In Soviet Russia, a Beowulf cluster imagines you !!!

    Next ...

  57. Now... by Anonymous Coward · · Score: 0

    Now it's time for the real test... Can it run Crysis smoothly on the highest detail?