Slashdot Mirror


SAPAC Unveils New Australian Supercomputer

Sean Burford writes "The South Australian Partnership for Advanced Computing (SAPAC) has unveiled its new AU$1.7 Million supercomputer named Hydra. It is an IBM 1350 Linux cluster with 126 compute nodes (xSeries 335), 1 head node (xSeries 335), 1 storage node (xSeries 345) and 1 managment node (xSeries 345). Hydra has a peak theoretical performance of 1.2 Teraflops, and has currently benchmarked at 682 Gigaflops. The current benchmark places it in the fastest three supercomputers in Australia and equivalent to the current number 80 in the world. The cluster has a total of 258 2.4Ghz Intel Xeon processors and 258GB of RAM. SAPAC expects to achieve a benchmark closer to 700 Gigaflops with further tuning. Hydra is hosted at The University Of Adelaide, who already host a 40 node cluster of Sun e420 machines."

48 of 227 comments (clear)

  1. if I didn't, someone else would have.... by sweeney37 · · Score: 4, Funny

    Nahhh, that's not a computer. Now this, this is a computer.

    Mike

    1. Re:if I didn't, someone else would have.... by Jason1729 · · Score: 2, Interesting

      It's 3 stories tall over an area the size of 4 tennis courts. When you fit that much computing power into a notebook, let me know.

      Jason
      ProfQuotes

    2. Re:if I didn't, someone else would have.... by deadsaijinx* · · Score: 4, Funny

      ooooh, and it even comes in designer colors. Sexy

      --
      YOU SUCK BALLS!
    3. Re:if I didn't, someone else would have.... by Anonymous Coward · · Score: 2, Insightful

      Yeah, but what I want to know is why they can't stick to the standards and use Quake3 fps for benchmarking? It works for everyone else.

    4. Re:if I didn't, someone else would have.... by Zork+the+Almighty · · Score: 3, Funny

      I'm suprised someone hasn't put type-R decals on it by now, just to squeeze out that extra 2% of performance.

      --

      In Soviet America the banks rob you!
  2. but is it... by Anonymous Coward · · Score: 2, Funny

    as powerful as "the Gibson"?

    1. Re:but is it... by Anonymous Coward · · Score: 3, Funny

      I don't simulate the Earth, I stimulate it, oooh yeah.

  3. Australian rules powers of 2^38B or what? by zptdooda · · Score: 2, Interesting

    "The cluster has a total of 258 2.4Ghz Intel Xeon processors and 258GB of RAM."
    258, hm? Izzat metric or sump'n? Maybe it's like that feet/metres thing with that Mars probe. Or is it like how AMD numbers their chip speeds? Is it a Southern hemisphere localised effect perhaps?

    When someone explains this to me I'm going to feel mighty small. Possibly 1/258 of my current stature.

    --
    Esteem isn't a zero sum game
    1. Re:Australian rules powers of 2^38B or what? by Anonymous Coward · · Score: 2, Informative

      129 nodes * 2 CPUs = 258 cpus
      129 nodes * 2GB = 258GB (actually 129 * 2048MB)

    2. Re:Australian rules powers of 2^38B or what? by sould · · Score: 4, Interesting

      Dunno about the processors - I dont see any reason why you'd need a power of two for them. Perhaps we've got two arrays of 2^7 processors with a controller processor each (=128+1 *2 = 258)

      But I suspect as far as the ram goes that the 258 gigs is 256 - but counting 1k as 1000 instead of 1024. (or possibly 1M as 10^6 instead of 1048576)

      Haven't you noticed the difference between what a vendor says is the size of a HDD compared to how many gigs you actually get when you put it in your PC?

    3. Re:Australian rules powers of 2^38B or what? by zptdooda · · Score: 2, Interesting

      As a matter of fact sir I did:
      - read through the whole linked article
      - opened a spreadsheet and tried to figure it out a couple of ways (failed miserably - it's been a long day)
      - searched for more information but mostly just found photographs and old presentations

      258=129*2 . Ah, yes I see now.

      Thanks for pointing out one of my character flaws though. Not laziness, but can't put 129 and 2 together.

      --
      Esteem isn't a zero sum game
    4. Re:Australian rules powers of 2^38B or what? by OneArmedMan · · Score: 2, Interesting

      *It is an IBM 1350 Linux cluster with 126 compute nodes (xSeries 335), 1 head node (xSeries 335), 1 storage node (xSeries 345) and 1 managment node (xSeries 345).*

      126 Nodes + 1 Head Node + 1 Storage Node + 1 Management Node = 129 Nodes total

      129 Nodes total * 2Gb ram per node = 258Gb ram for the cluster

    5. Re:Australian rules powers of 2^38B or what? by vandan · · Score: 2, Insightful

      Touchy?
      Arrogant?
      I think you're forgetting who got all upset about a few building falling over and then got retribution by forging evidence of 'Wigwams of Masturbation' and blackmailing the rest of the world into supporting an illegal invasion of a defenseless country. All for your stupid American pride.
      So who is touchy?
      And arrogant?

  4. Is this news? by KFury · · Score: 4, Interesting

    Not to flame or troll, but considering that over 90% of the top 80 came out in the last 30 months, how big a deal is this? Third fastest computer in Australia? Sheesh.

    A computer faster than this is born every two weeks.

    1. Re:Is this news? by PerryMason · · Score: 4, Interesting

      Its really nothing huge, but you also need to consider the cost involved. AU$1.7 million is about US$1.1 million. So for about a million US$1 you could get in the top 100 supercomputers in the world.

      Looking at the latest top 500 list this would put it as the third most powerful 'self-made' system in the world. For that reason I think it deserves at least a mention and add the relatively low cost and you've got a /. story.

      --
      "I'm tired of all this 'Aren't humanity great' bullshit. We're a virus with shoes" - Bill Hicks
    2. Re:Is this news? by KFury · · Score: 3, Informative

      Looking at the latest top 500 list this would put it as the third most powerful 'self-made' system in the world.

      I disagree. Hydra would qualify as "IBM made" as it uses a standard network of standard IBM machines. For comparison, the top 'self-made' computer, Sandia's Cplant Cluster, was built by the lab from off the shelf components, wired together by custom drivers written by the engineers at Sandia.

      If the thrust of this story was an amazing $AU/tflop ratio, it didn't come across at all in the summary.

    3. Re:Is this news? by sql*kitten · · Score: 2, Insightful

      So for about a million US$1 you could get in the top 100 supercomputers in the world.

      For $1M you could buy a load of computers, sure. But what is the cost of a building to put them in? A while ago I did some consulting for a major telco/colo provider. Their single biggest expense was electricity to run their air conditioning and dehumidifiers. It cost more than renting the building. They were seriously considering buying a utility company to get a better rate on electricity. Also on the cards was a relocation to Alaska, but the technology just isn't there yet to run truly "lights out" so they would have adopted an oil rig model - flying sysadmins out for 4 weeks on 2 weeks off, like oil companies do for rig workers. (The story ends before they could actually do any of this when the dotcom bubble burst and all their customers stopped paying their bills).

      The building, the environmental controls, staff to run the system, staff to run the building (security, janitors, canteen staff and so on) - it all adds up. You would need to spend a lot more than $1M to get into the top 100.

  5. Press Interview.... by ewhenn · · Score: 2, Funny

    A spokesperson for SAPAC in a recent press interview has stated that the intent is to create the largest SIMS server on the internet.

  6. Obligatory Australian joke thread by yppiz · · Score: 2, Funny
    So this is what the Simpsons meant by Australia's giant boot.

    --Pat

  7. By crikey mate this specimen is enormous... by Anonymous Coward · · Score: 5, Funny

    be very, very careful around this one mate.
    It is very, very dangerous.

    Look at the size of the heatsink on that one!

    And this buggers attck fast. And I mean real fast.

    Crikey!

  8. GB vs. MB by lingqi · · Score: 3, Interesting
    ...and 258GB of RAM...

    Is it me or anyone else misread it as "256MB"?

    Actually, misreading it lead me to think about a mainframe at my college, which was an SGI with 12 processors and 512MB of memory.

    The thing is, though - when I first went in the college, we were all like "WOW that's a lot of system resources." When I got out four years later I was carrying that much memory on my laptop...

    breakneck speeds, man.

    However, regardless - (with all due respect) why is this such a big deal that australia limped to #80 on the fastest computer list? didn't other linux clusters break teraflops quite a long time ago? EarthSim was neat because it put THAT much more distance between another country and the US (and nearly nobody saw it coming) - but this seems to me hardly news, besides the possible "one of the fastest computer in australia runs linux," or something...

    --

    My life in the land of the rising sun.

  9. How long... by Esion+Modnar · · Score: 4, Funny
    ...til somebody asks it, and it replies:

    42.

    --

    They say the first thing to go is your penis. Well, it's either that or your brain. I forget which...
    1. Re:How long... by jerde · · Score: 5, Informative

      I'm sorry. This just canNOT go unanswered. Nay, we must resort to blatant copyright violations to cure this NOW. The quote is from the late Douglass Adams's book, The Hitchhikers Guide to the Galaxy. Geeks around the world resonate with Adams's humor, such that a good number of /. references are to his work.

      So go read the book! Now! Meanwhile, to whet your whistle, and explain the 42 reference, here are the pertinant excerpts from Hitchhiker's guide:

      Chapter 25: There are of course many problems connected with life, of which some of the most popular are Why are people born? Why do they die? Why do they want to spend so much of the intervening time wearing digital watches?

      Many many millions of years ago a race of hyperintelligent pan-dimensional beings (whose physical manifestation in their own pan-dimensional universe is not dissimilar to our own) got so fed up with the constant bickering about the meaning of life which used to interrupt their favourite pastime of Brockian Ultra Cricket (a curious game which involved suddenly hitting people for no readily apparent reason and then running away) that they decided to sit down and solve their problems once and for all.

      And to this end they built themselves a stupendous super computer which was so amazingly intelligent that even before the data banks had been connected up it had started from I think therefore I am and got as far as the existence of rice pudding and income tax before anyone managed to turn it off.

      It was the size of a small city.

      Its main console was installed in a specially designed executive office, mounted on an enormous executive desk of finest ultramahagony topped with rich ultrared leather. The dark carpeting was discreetly sumptuous, exotic pot plants and tastefully engraved prints of the principal computer programmers and their families were deployed liberally about the room, and stately windows looked out upon a tree-lined public square.

      On the day of the Great On-Turning two soberly dressed programmers with brief cases arrived and were shown discreetly into the office. They were aware that this day they would represent their entire race in its greatest moment, but they conducted themselves calmly and quietly as they seated themselves deferentially before the desk, opened their brief cases and took out their leather-bound notebooks.

      Their names were Lunkwill and Fook.

      For a few moments they sat in respectful silence, then, after exchanging a quiet glance with Fook, Lunkwill leaned forward and touched a small black panel.

      The subtlest of hums indicated that the massive computer was now in total active mode. After a pause it spoke to them in a voice rich resonant and deep.

      It said: "What is this great task for which I, Deep Thought, the second greatest computer in the Universe of Time and Space have been called into existence?"

      [...]

      "O Deep Thought Computer," he said, "the task we have designed you to perform is this. We want you to tell us ..." he paused, "... the Answer!"

      "The answer?" said Deep Thought. "The answer to what?"

      "Life!" urged Fook.

      "The Universe!" said Lunkwill.

      "Everything!" they said in chorus.

      Deep Thought paused for a moment's reflection.

      "Tricky," he said finally.

      "But can you do it?"

      Again, a significant pause.

      "Yes," said Deep Thought, "I can do it."

      "There is an answer?" said Fook with breathless excitement."

      "A simple answer?" added Lunkwill.

      "Yes," said Deep Thought. "Life, the Universe, and Everything. There is an answer. But," he added, "I'll have to think about it."

      [...]

      Fook glanced impatiently at his watch.

      "How long?" he said.

      "Seven and a half million years," said Deep Thought.

      [... skip ahead to chapter 27, seven a

      --
      INsigNIFICANT
  10. yeah but by toddhunter · · Score: 5, Funny

    They are still going to have to upgrade when Doom 3 comes out

  11. Life in the fast lane.... by MrCreosote · · Score: 4, Funny

    At least now there is one thing that goes fast in Adelaide.

    --
    MrCreosote Meow!Thump!Meow!Thump!Meow!Thump! "You're right! There isn't enough room to swing a cat in here!"
  12. Its time... by thogard · · Score: 2, Informative

    Here's the museum peice its going to replace.

  13. Why aren't they using Athlons? by leereyno · · Score: 3, Interesting

    It really is too bad they can't use Athlons.

    The per-clock performance on an Athlon is much better than what you'll get from a P4 based Xeon, and that is just on integer. When it comes to floating-point performance a lower clocked Athlon will meet or beat the performance of a higher-clocked P4.

    Right now the only SMP chipset for the Athlons is the 761, which is several years old and lacks dual-channel capability. It also requires the use of registered ECC memory. If the Athlon's had an SMP chipset comparable to the NForce2 or Intel's 775 then it would be a very different story.

    Right now the going rate on pricewatch for an Athlon 3000 is only $10 more than a 2.4 Ghz Xeon, and it would spank that Xeon on floating point which is exactly what is important for a supercomputer.

    I hope that the clustering technology they're using makes good use of SMP systems because if it doesn't then they may very well have misspent their money.

    Lee

    --
    Muslim community leaders warn of backlash from tomorrow morning's terrorist attack.
    1. Re:Why aren't they using Athlons? by Anonymous Coward · · Score: 5, Funny

      They must be worried about Global Warming.

    2. Re:Why aren't they using Athlons? by sjames · · Score: 5, Interesting

      Actually, Athlon is not faster than the P4 Xeons at double precision floating point. Double precision is frequently required for scientific computing and is used in the Linpack benchmark for the top500.

      The current dual Athlon chipset is the 760MPX. The Intel i7501 is the preferred chipset for dual P4. It supports dual channel ECC DDR ram and the 533MHz FSB. These days, nobody wants non-ECC ram for a top 500 cluster. It's not that much more expensive these days compared to decently rated non-ECC ram.

      Then there's the cost of air conditioning 258 Athlons...

      I'd say they made the right decision.

    3. Re:Why aren't they using Athlons? by MetricT · · Score: 5, Interesting

      We're just a few days from bringing up a 300 processor cluster of the exact same type of computers they are using, so maybe I can shed some light. There are several reasons for picking Xeons over Athlons at the moment.

      1. If your app uses double precision floating point, and you can recompile your app using SSE2, an Intel will easily beat the AMD. AMD does scalar floating point operations faster per clock. Intel does vector flops faster. Most interesting real-world problems use vector flops.

      2. Memory bandwidth. Most chipsets can only deliver a fraction of their theoretical bandwidth. I've seen speed differences of 25% running code on identically configured machines, one having Intel E7500 and the other with a ServerWorks GC-LE (the ServerWorks smokes...) And those are *good* chipsets. I have yet to see an Athlon chipset that wasn't crap.

      3. Managability. The x335's are pretty damned slick. I *love* the built-in KVM switch and remote diagnostics. You can daisy chain north of 21 nodes together (I think 35!) and you just have one cable coming off of them.

      4. Total cost of ownership. Our previous p3 cluster was assembled (before I arrived) from Pricewatch parts. We initially experienced a 25% failure rate on memory, and spend an inordinate amount of time fixing random problems. 40 of the p3 nodes takes more than three times as much administrator time as 160 IBM x335's. Spending an extra $50,000 on good, quality parts is cheaper than hiring a competent sysadmin. Don't "efficient" yourself to death.

      Having said all that, I'm *really* looking forward to Opteron. We're getting some in a week or so. 64 bit + SSE2 support is going hard to beat.

    4. Re:Why aren't they using Athlons? by mc6809e · · Score: 3, Informative

      It really is too bad they can't use Athlons.

      The per-clock performance on an Athlon is much better than what you'll get from a P4 based Xeon, and that is just on integer. When it comes to floating-point performance a lower clocked Athlon will meet or beat the performance of a higher-clocked P4.


      What you see as an advantage for the Athlon is actually a disadvantage.

      The Athlon is trying to do too much per clock and this limits its maximum clock rate. What matters is realized performance. Right now, less work at a higher clock seems to be pulling ahead.

      It really comes down to how large you can make the product (work x clock rate). Less per clock isn't bad if it means you can greatly increase clock rate.

  14. The thing is... by teamhasnoi · · Score: 3, Funny

    they *still* can't get sound to work, and their window manager crashes every time they play TuxRacer.

  15. Re:Difference? by aaaurgh · · Score: 3, Funny

    Management never uses its Head. ;-)

    --

    Go permanent? In your dreams and my worst nightmares.
  16. Couple of other details not in the article by lachlancs · · Score: 3, Interesting

    The cluster is running IBM Cluster Systems Management, not Beowulf, and is using Myrinet Networking.

  17. Re:imagine by cyril3 · · Score: 4, Funny

    nobody says doolally anymore mate. It's all so bloody American nowadays. The word is fuckers.

  18. Benchmark and interconnects? by Anonymous Coward · · Score: 2, Interesting

    They didn't mention which ISL interconnect they were using for the (presumably) Linpack benchmark number of 682 Gigaflops, but it would be interesting to see a full description of their equipment. I run an identical 1350 system, 126 x335's with 2 x345's for management, with a Myrinet (http://www.myri.com) switch and I've been averaging in the low 600's. And IBM signed off on that as being the "practical" maximum for the cluster. Hmm. (Reaching for the phone...)

  19. even more! by golgotha007 · · Score: 2, Interesting

    an even more interesting supercomputer!

    Japan's Earth Simulator Center has 10 TB of main memory and the theoretical performance of 40Tflops!

    quite a system and definetely worth checking out.

  20. The irony of it all. by Anonymous Coward · · Score: 3, Insightful

    An American cartoon makes a joke about the Australian government booting a kid in the arse.

    Yet, Australia has outlawed any form of corporal or capital punishment, but the US still lets teachers hit kids and kills people with death sentences. This isn't the pot calling the kettle black, it's the pot calling the fine cutlery black.

    Australia has sane, civilised laws. The USA kills people, hits people, and arms its citizens to the teeth with guns.

    Ah, the irony of it all.

    1. Re:The irony of it all. by UnknowingFool · · Score: 2, Interesting
      An American cartoon makes a joke about the Australian government booting a kid in the arse.

      Geez, it was a cartoon. A parody. A caricature. The great thing about the Simpsons is that no group is spared from their biting satire.

      Remember this is the same cartoon that shows that all nuclear workers are inept and cause meltdowns all the time. The same show whose police force can't find sand on a beach, where the male father character spends most of his time drinking in a bar, and school children eat exercise mats for lunch because the school is so poor.

      This is a world that makes fun of Americans. All Texans are gun-toting cowboys. New Yorkers are unapologetically rude. Southerners are incestuous hicks. Californians are beach bums that say "Dude" a lot.

      Other countries are not spared: Europeans are all pony-tail wearing Euro-trash. Canadiens are nice people who will do anything for an American dollar. Koreans are slave driving animators. British people are both rigidly proper and trash-burning soccer hooligans. I mean does anybody really take any of this as fact. No one really believes that Australians punish people by booting them.

      It's unfortunate that you take offense to it, but your generalization of Americans is just the same as the Simpsons generalization of Australians except that theirs was meant to be a parody.

      By the way, American doesn't arm its citizens. We do that ourselves.

      especially in Texas.

      --
      Well, there's spam egg sausage and spam, that's not got much spam in it.
  21. teraflops? by fatboyslack · · Score: 2, Funny

    Isn't that what an impotent Bin Laden would suffer? Or is that any impotent person? Maybe its fear of 'flopsy'?
    *sigh*
    its the end of the week and I'm going home in four minutes. What is this crap? In other news, Germany has built the 90th largest ship in the world, the US has finished construction on the thirteenth smallest... you get the idea.

    --
    Everyone thinks of changing the world, but no one thinks of changing himself. -- Leo Tolstoy
  22. compensating for something? by lingqi · · Score: 4, Funny
    Last place I worked, each developer got his own personal 16-processor machine with 8 GB of RAM for application testing. These weren't servers. They were workstations, individual workstations for individual developers to use.

    Aww that's nothing. Last place I worked everybody - including the janitorial staff, had their own robotic assistants modeled after Natalie Portman, and the personal computers everyone used for were liquid nitrogen cooled Cray with 295 GaAs based processors, and just over half a TB of memory pre system. That and the computers were connected to dual 40" OLED panels capable of 3640x2400 resolution each at 1500:1 contrast. Every system had neurological with supplimental eye-tracking input systems so you can think about moving the cursor in the 3D desktop and it would be done before you finished thinking about it. And that's only the computer for just reading and writing email! you should see the stuff we used for application development and integration testing. Pff.

    --

    My life in the land of the rising sun.

  23. The University of Adelaide... by CaptainPotato · · Score: 5, Informative
    ...will do almost anything for a bit of publicity at the moment. As the eighth university of the so-called 'Group of Eight' premier league institutions in the country, the University of Adelaide is a mess at present. There is little leadership, poor strategic planning, a recent Government survey that slammed it in many areas, and so on. The announcement of this new system is meant to show how technologically advanced the place is, and how it leads the way.

    This couldn't be further from the truth. Ask the postgraduates, who have Mac LCIIs and 486-DX33s on their desks (I kid you not). Ask the academics, who have been retrenched in recent years (in some facultis, 25% of academic staff lost their jobs because of the university's financial problems), ask the users of its library, which has HUGE funding problems.

    Whilst the new machine may be very nice and have some power, the University of Adelaide really sees it only as a PR campaign (hell, it even made it to Slashdot!), rather than anything significant for the sake of scientific advancement - okay, the researchers, who will use it may have a different opinion, but not the University iself.

    --
    I heard that your library burnt down and destroyed your only two books - and one was not even coloured in yet.
    1. Re:The University of Adelaide... by tconnors · · Score: 2, Funny

      At least the teaching is better than Monash or Swinbourne (or so I hear).

      Hey, I take offense :)

      Oh wait, there is no teaching in astrophysics as Swinburne, we just steal all the postgrad students from the other universities.

  24. Australia's fastest supercomputer... by DamonSearle · · Score: 2, Informative

    is the APAC Alphaserver SC located at the Australian National University in Canberra and is 63rd on the top500.org list at 825.50 GFlops Rmax http://nf.apac.edu.au/facilities/

  25. Reason for the funny number, mate... by Mr_Glooby · · Score: 3, Funny

    Well, I live in Australia, and note the confusion caused by the number 258, so here is why...
    The number between 5 and 7 may not be spoken here because of its similarity (when spoken with a New Zealand accent) with a certain act often carried out between mammals.
    In fact a whole new mathematical system is being developed (based on pictograms) to avoid political insensitivities in the Land where legislation has been passed to the effect that children access the internet, and so the internet must not contain content (including numbers) that might corrupt the young.
    The pictogram for the number that dare not speak its name is an image of two trees. (tree and tree is s.x).
    Similarly, three trees with 'watermarks' (evidence of the recent passing of puppydogs with full bladders) represents the number 99. (dirty tree + dirty tree + dirty tree = 99).
    The same pictogram with underscores (here called doggy doo-doos) represents 100.
    (dirty tree and a turd, dirty tree and a turd, dirty tree and a turd...)

    Besides, our new supercomputer sure beats the 286 we've had to share for the last 10 years! Them Y2K problems are getting to be a real pain!

  26. Supercomputers by [cx] · · Score: 2, Interesting

    When will the speed stop mattering?
    What is the theoretical speed of 0 latency for computations?

    This may seem like a stupid question, but I never heard once in star trek them saying our computer is such and such fast. They must have reached a limit that allowed them almost instant computation.

    So what would that be in our measured terms however primitive they might be in the longterm outcome of our computers?

    10000 Ghz? 1 Million ghz?

    I dont know,
    any biters on this bait?

  27. Go Oz... by Cackmobile · · Score: 2, Funny

    Aim high, we build this whiz bang thing and its only No. 80 in the world. What happened to Aussies innovation. We used to be able to build these things out of old fosters cans.

    --
    -- Karma Karma Karma Karma, Karma Chameleon - Boy George
    1. Re:Go Oz... by mallie_mcg · · Score: 2, Informative

      Aim high, we build this whiz bang thing and its only No. 80 in the world. What happened to Aussies innovation. We used to be able to build these things out of old fosters cans.

      I Call you out, you are not an Aussie, for fucks sake mate, no aussie will willingly drink fosters beer, let alone in cans, and those that do, well they revoked their citizenship.

      --


      Do the following really mean anything? SCSA MCP CCSA CCNA
      --I'm not actually after an answer!