Slashdot Mirror


Indiana University Dedicates Biggest College-Owned Supercomputer

Indiana University has replaced their supercomputer, Big Red, with a new system predictably named Big Red II. At the dedication HPC scientist Paul Messina said: "It's important that this is a university-owned resource. ... Here you have the opportunity to have your own faculty, staff and students get access with very little difficulty to this wonderful resource." From the article: "Big Red II is a Cray-built machine, which uses both GPU-enabled and standard CPU compute nodes to deliver a petaflop -- or 1 quadrillion floating-point operations per second -- of max performance. Each of the 344 CPU nodes uses two 16-core AMD Abu Dhabi processors, while the 676 GPU nodes use one 16-core AMD Interlagos and one NVIDIA Kepler K20."

25 of 83 comments (clear)

  1. Biggest? Really? by wonkey_monkey · · Score: 3, Interesting

    Computers used to be a lot bigger.

    --
    systemd is Roko's Basilisk.
    1. Re:Biggest? Really? by Anonymous Coward · · Score: 2, Interesting

      How can you tell? In TFA, you just have a photo of one corner of the building.

    2. Re:Biggest? Really? by reboot246 · · Score: 2

      That's a building? It looked more like a stack of 4x8 Styrofoam sheets. I guess that's what passes for architectural design nowadays.

    3. Re:Biggest? Really? by cdrudge · · Score: 2

      IU is a public university. Would you prefer tax dollars get spent on a masterpiece of architectural design for a data center?

    4. Re:Biggest? Really? by Z_A_Commando · · Score: 3, Insightful

      It's a Tier 3 data-center built to withstand F5 tornadoes and earthquakes. All the pretty glass stuff doesn't really survive in 300MPH winds. Also, the main receiving area in the back looks like something out of Jurassic Park. And in Bloomington, they think limestone is very pretty.

  2. Re:Dedication ceremony? by Cenan · · Score: 3, Insightful

    Or it could be something completely innocent like cutting of tape and speeches and shit. You know the kind of stuff you do when you show your stakeholders what their money went to. Stop your idiotic religious babbling.

    --
    ... whatever ...
  3. Imagine a Beowulf.. by blackicye · · Score: 2

    Cray is still kicking around??

    1. Re:Imagine a Beowulf.. by fuzzyfuzzyfungus · · Score: 4, Informative

      Cray is still kicking around??

      I don't think they've kicked out an original processor design in ages; but they are still(among) those you talk to if you want something a little more tightly coupled, and/or a bit more 'turnkey' than "10,000 of whatever dell is selling, and some 10GbE switches".

    2. Re:Imagine a Beowulf.. by RicktheBrick · · Score: 3, Informative

      Maybe it is because Seymour Cray died in 1996 of complications from a automobile accident. http://en.wikipedia.org/wiki/Seymour_Cray I would think that most people who have a passing interest in supercomputer would have known that fact. Seymour Cray did a lot of work in establishing the supercomputers. I can remember seeing his supercomputers on the cover of Popular Science back in the 70's. I think he deserves a little more respect than shown here by that remark.

  4. Biggest and probably dull too look at... by mendax · · Score: 2

    It's great to see a university have a monster like this for research use. And old universities you would think are well suited for these kinds of monsters. Their computer centers were built at a time when the computers really were filled with monster machines that your iPad would run circles around today performance-wise. They were replaced in the 1990s by servers that would fit into a closet. But they still have all this space that can be filled with racks upon racks of supercomputer nodes. However, I suspect that IU may have built a new building for these new and improved monsters. But anyway, these new monsters are nice to contemplate but they're not a pretty to look at. Computers in the old days were designed to be both functional and attractive to members of the unwashed masses who could gaze at them through the glass windows and drool, and be hypnotized at the blinking lights and the spinning tape drive reels spinning. And the glass windows were there to allow the institution to show the machine off as a kind of status symbol. There was no picture in the article of this new beast but I will bet $0.02 that it's pretty dull looking.

    --
    It's really quite a simple choice: Life, Death, or Los Angeles.
    1. Re:Biggest and probably dull too look at... by fuzzyfuzzyfungus · · Score: 2

      Check this one out...

      (More broadly, though, the point is largely valid. Reel-to-reel deserved to die, technologically; but damn did it look 'high tech' churning away in the background, now that everything fits in standard 72u racks, it's mostly just a 'Should we go for 'basic black, or spring for custom powdercoat and a cool cutout design for the doors?' game.

      Of course, seeing as the CM-2 won 'coolest-looking computer of all time', with the CM-5 playing 'solid; but ever-so-slightly-disappointing-sequel', perhaps it's only fair for everyone else to just stop trying.

    2. Re:Biggest and probably dull too look at... by dbIII · · Score: 2

      Not ten feet away from me is a box of nine track reels - it's still not dead yet. It should be, and it would be if people had transcribed their media within a sane timeframe, but it's still in use on occasion. I don't know if those reels in that box will ever be read again since they were a third copy in 1982, but I had to get a few transcribed up to a couple of years ago after the original owners threw out their copies and then found out a decade later that they wanted the data.

    3. Re:Biggest and probably dull too look at... by mendax · · Score: 2

      Looks rather boring to me. But I'm old school... and after just made my first visit to the Computer History Museum in Mountain View in five years and seen bits of the beauty of old room-filling computers from the last sixty years on display, I can say with some certainty that the IU machine is dull to look at.

      --
      It's really quite a simple choice: Life, Death, or Los Angeles.
  5. Research Hell by kurt555gs · · Score: 4, Funny

    Can you imagine how many Bitcoins this thing could mine per hour?

    --
    * Carthago Delenda Est *
  6. Re:Won't be long now... by JustOK · · Score: 4, Insightful

    you must be new here.

    --
    rewriting history since 2109
  7. Re:Dedication ceremony? by Anonymous Coward · · Score: 5, Funny

    I realize that you don't "believe", but SkyNet will be real one day and we never know which super computer will be the first node in humanity's Beowulf Cluster of Death.

    Maybe, just maybe, if we're nice to them and show them some respect they'll let us service their modules until we die of natural causes.

  8. some big ten schools are not sports colleges by Joe_Dragon · · Score: 2

    some big ten schools are not sports colleges.

    No at some you have real classes to take and pass.

  9. Re:Not many with only 676 GPU nodes by flowerp · · Score: 2

    Bitcoin is now dominated by FPGA and ASIC miners (dedicated hardware), most GPU farms have moved on to litecoin.

    --
    --- Eat my sig.
  10. I have to question the wisdom of this by Virtucon · · Score: 2

    While it has been in vogue for years for universities to have this capability in-house, I have to question the wisdom of this kind of investment in a few areas. First, recently there was an article on Slashdot posted about the Federal Government retiring Roadrunner because in less than 5 years because it was too much of a power hog. I haven't seen anything in the press releases about Big Red that would indicate that IU has solved the power obsolescence issue; in five years, we'll probably see Big Red II retired because it wasn't power efficient given newer technology. IMO in five years, IU will be looking to fund Big Red III so I hope they get their value out of this investment, total operating costs (TOC) because it has to be very, very expensive to keep the lights on for this thing. Second, with Utility Computing models available in the Cloud with AWS, Google Apps etc. for large scale experiments, more and more companies are choosing the utility model to run their research rather than buying it. I don't need to cite them all here but there's stories day in and day out of companies and universities leveraging utility based, cloud models for HPC. You have one resource here at IU when you could lease multiple Cloud based resources with hundreds of thousands of nodes simultaneously, not just rely on one large machine in your data center. I can imagine there are quite a few experiments that IU can do with it, but when I read their press, it's available to IU students and Faculty, does that mean they won't let other academic institutions use it? If that's true it's a very expensive resource that only one institution can use and I doubt that they can keep it busy 24x7x365 for its useful life with experiments. Maybe I'm wrong but I just can't see this kind of large scale investment being feasible over the coming years because it will just be too inexpensive and disposable to run it in a Cloud based model.

    --
    Harrison's Postulate - "For every action there is an equal and opposite criticism"
    1. Re:I have to question the wisdom of this by gtall · · Score: 3, Interesting

      Indiana University is not simply a university; it is a state school system with several regional campuses. Oddly enough, Purdue is Indiana's second state school system with its own regional campuses. They both share a campus at IUPUI (Indianapolis). I'd be very surprised if there is any free time left for this. And if there is, IU would likely just lease it to Purdue.

      All in all, it is probably cost effective for them to do this. They are unlikely to have made this decision in a vacuum; they are well aware of the alternatives. (I'm an IU alum).

    2. Re:I have to question the wisdom of this by riley · · Score: 4, Insightful

      Cloud computing is not appropriate for all types of research computing. Let's say you want to use Amazon's cloud offering, but you have a genomic and geospatial dataset of 60 TB. While not ubiquitous in research computing, it is not unheard of, especially in the fields of bioinformatics. The cost of storage and the cost of transfer will each away at whatever grant that is funding the research. This is a business decision. Does the cost of the computing resource and operation result in [ more grants / better faculty retention ] than not having it?

      The cost-benefit analysis has been done, and while cloud computing has its place, there are additional costs that make it problematic. The cloud is not a panacea.

      That said, in five years IU could very well be looking for its next big computer. The average lifespan of a supercomputer is 5-8 years. So, five years is on the early side of looking for the next big thing, but not outrageously so.

      Disclaimer -- I run high speed data storage for a university. I've written acceptance test measures for high performance computing resources. I've done the cost-benefit analyses.

  11. FWIW by jimbrooking · · Score: 2

    The IU machine at 1 PFLOP would rank around 24th in the world and 11th in the U.S. (http://www.top500.org/list/2012/11/).

  12. Re:Why two different GPUs / graphics cards by Blaskowicz · · Score: 2

    There aren't two different GPUs in a node, the AMD Interlagos is a Bulldozer Opteron, made of two dies on the chip, same die as the FX-8150 CPU.
    CPU nodes run newer Opteron, about 10% more effcient, made of two Piledriver dies (similar to the FX-8350). It's weird that two different kind of CPU are used but that's probably because the GPU nodes were already made, validated etc.

  13. Re:Won't be long now... by Entropius · · Score: 2

    Yes. What else would it run?

  14. It would be nice... by MrLizard · · Score: 3, Insightful

    ...if this got as much attention in the local press as throwing a ball into a basket does.