Slashdot Mirror


Cool/Weird Stuff To Do On a Cluster?

Gori writes "I'm a researcher at a university. Our group mainly does Agent Based Modeling of interdisciplinary problems (think massive simulations where technology, policy, and economics meet). Recently, we managed to get a bunch of money for a High Performance Cluster to run our stuff on. The code is mostly written in Java. Our IT support people are very capable of setting up a stable cluster that will run Java perfectly. But where's the fun in that? What I'm trying to figure out are other, more far-out and interesting things to do with this machine — think 500+ Opteron cores, 2 GB RAM per core, a gigabit interconnect with some badass switches, a massive storage array, plus a bunch of UltraSPARC boxes. So at times when there's no stuff to crunch, I'd like to boot the thing up with a 'weird' system image and geek around in the name of science. Try fancy ways of building models, dynamically adding all sorts of hardware to it, etc. Have different schedulers compete for resources. Imagine a Matlab vs. Boinc vs. ProActive shootout. Maybe run plan9 on it? Most of us are not CE/CS people, but we are geeky enough. So, what would be the coolest and most far out thing you would do with this kind of hardware ?"

13 of 608 comments (clear)

  1. How about you don't? by Anonymous Coward · · Score: 5, Insightful

    And save the environment a little bit?

    1. Re:How about you don't? by rubycodez · · Score: 5, Insightful

      because it won't make one iota of difference to the environment whether that thing is on or off, your one of those token bullshit symbolism over substance wanks. That's as stupid as advocating abolishing drag racing to save gasoline.

    2. Re:How about you don't? by aarner · · Score: 4, Insightful

      "because it won't make one iota of difference to the environment whether that thing is on or off..."

      assuming it's 500 cores, and also assuming (conservatively) that the diffrence between idle and full load is only 100 watts per processing unit - that means about 50 extra KWh consumed by this thing at near full utilization.

      X 24 hours = about 1.2 million watts.

      1 short ton of coal yields about 2500 KWh of electricity at average efficiencies.

      If I've done the math right, you can imagine dumping an extra 1/2 ton of coal on a fire somewhere to run this thing (at load) for 1 day.

      According to DOE - Burning coal produces 2.117 lbs of carbon per KWh. So even 1 hour at full load introduces an additional 50 pounds of CO2 into the atmosphere

      Again, all assuming this cluster sits somewhere (like america) where most of the electricity gets generated from coal or other fossil fuels. YMMV.

      Important to remember - there isn't any storage or margin in the power grid. Every time turn on a light switch or run a CPU up to max with SuperPrime, somewhere a turbine starts turning that little bit faster - it's always got to be nearly in balance.
       

  2. Coolest? by Vectronic · · Score: 5, Insightful

    "So, what would be the coolest and most far out thing you would do with this kind of hardware?"

    Instead of pissing around with stuff that may not go anywhere other than a few giggles over lunch.

    Why not just rent, or lend it out to people who don't have the funding or equipment that could use this cluster for a better purpose than "playing around"?

    Just saying...

    1. Re:Coolest? by gad_zuki! · · Score: 5, Insightful

      Its incredible a university would let this kind of equipment go to waste. If people arent clamoring to run things then you either have a non-existent (or terrible) CS department or too much money that should have gone elsewhere.

      Regardless, there are tons of grid clients out there. There's always something to run.

    2. Re:Coolest? by nick_davison · · Score: 5, Insightful

      Its incredible a university would let this kind of equipment go to waste. You're not from the education world, are you.

      Let me see if I can help explain...

      Money comes in to education through grants. Grants are usually awarded to whoever can make the best case. You'll notice I didn't say "deserving" or "beneficial to mankind" case. The best case is often the one that's written by someone who knows how to game the system be it through politics or releasing sensationalist research that may not prove anything much to anyone.

      Publishing articles are kinda nice. Publishing books is usefull for a little extra income from screwing your students who have to buy the latest version you update each year. Having the media pick up your research because you just claimed women are smarter than men and the secret to cold fusion powered cars that also run on water is far, far better.

      Once you have this money, it's yours to do with as you wish. Just one thing. Don't ever, ever let it be seen that you didn't really need it. If that happens, how much budget do you think the university is going to give you on the years where your grant applications fail? How about those you beg for money from, next time? If you got money to buy a supercomputer, you need it, 24/7, until you declare it's obsolete. If you don't, they might ask why a pretty-nifty-computer wouldn't have worked just as well. And so, for that reason, no one else gets time on it. Hell, you might only need it because it turns out it's the perfect sized doorstop for a door you had... but let anyone think you don't need it and you're screwed in the magical world of academia.

      It's in conflict with the notion of academia being "for the good of mankind" but no more so than the notion of government being "for the people." Both simply serve the people within it... researchers or politicians. The rest is set dressing to ensure others keep paying for it.

  3. Stone Soup by MetricT · · Score: 5, Insightful

    I (Mat) work at Vanderbilt University's supercomputing center. Our university supercomputing center was originally a joint venture between the proteomics and high-energy physics departments, but they decided to make it a independent university-wide initiative to bring HPC tools to all users.

    Before we founded the center, there were a lot of groups that required computing on campus, but it was highly inefficient. Their local clusters had lots of free cycles (low return on asset) that they couldn't effectively share with other users, the clusters were down quite often (grad students and postdocs are poor sysadmins, plus they should be doing actual research anyway). Several other problems related to either pooling of resources or pooling of knowledge, you get the idea...

    I highly recommend setting up a batch scheduler such as Torque/Maui and opening your cluster to all researchers on campus. You'd be surprised how much demand is out there. We have all the usual math/science/engineering/biomedical users, plus users in more esoteric fields (nursing, accounting, music, psychology). You can always give your group a higher job priority if needed. It gives a higher return on asset and gets lots of goodwill on campus (and, potentially, at funding agencies). You can charge users for support, storage, etc for cost recovery, or even use it as a revenue source if your grants allow.

    Having different types of users also allows cross-pollination of ideas. We have a large number of biomedical researchers who are now using a high-energy physics software (geant), biomedial people who are teaching other users how to program in R, etc. These are avenues for research/discovery that didn't exist before.

  4. Re:Vista? by Crimson+Wing · · Score: 4, Insightful

    I think that would be an ideal setup to run Vista on. I heard that with SP1 you might only need half of the equipment you currently have. The Vista-needs-uber-comp jokes are getting extremely old. Get some new material.
    --
    Sig? What's that? Oh, 'signature'...and it's supposed to be witty? Right...
  5. Re:Vista? by somersault · · Score: 4, Insightful

    You should maybe hide your signature when you say things like that.

    Itg is widely accepted that Vista is a waste of resources, and therefore all articles about powerful computer resources are going to have Vista jokes. You can't kill off a meme on your own. If you don't like repetetive humour then perhaps you should change your moderation to mod down all funny comments.

    Anyway, slightly back on topic - I think they'd want to keep it a cluster rather than degenerate into a clusterfuck, so it may be better to avoid installing Vista.

    --
    which is totally what she said
  6. Re:Imagine . . . by somersault · · Score: 4, Insightful

    Uh. So the endless Beowulf jokes are funny to you, but the nowhere near as long running Vista ones aren't? You perhaps should go into therapy to resolve your Vista issues. I'm intrigued as to why you consider it better than XP in any way.. apart from apparently the calendar is more comprehensive than XP for tracking changes in our date system over the last while.. but other than that. I honestly don't see the benefits. I'm not being hypocritical either - I was doing fine with 98 until games started requiring XP. And I'm writing this on OS X.

    --
    which is totally what she said
  7. Nothing like hypocrisy! by Anonymous Coward · · Score: 4, Insightful

    Couldn't you be doing something yourself to save the environment right now - something like turning off YOUR computer instead of browsing slashdot? Oh, wait - that would require YOU to do something. That kind of environmental activism is never as much fun as simply preaching to other people what THEY should be doing. Hypocrisy is SO much fun - carry on!

  8. Re:better yet by Anonymous Coward · · Score: 5, Insightful

    I think reverse-engineering reality is called "Physics".

  9. Re:Super photogenesis by Crookdotter · · Score: 4, Insightful

    You would also have everything possible within 255X255, but as images can be tiled, you would also have an almost infinite canvas with infinite possibilities.You want a time machine? Well, if it's possible, then SOMEWHERE in these images is the blueprints, chopped into nice 255X255 chunks.

    As well as all porn being thumbnailed, why not find the tiles for it in HD resolution instead? Or better yet, in 10000X10000 pixels?

    So in essence, such a program would spit out every frame of every movie, in better than current HD resolution, that will ever be made by humans (or aliens, or anything). It would also contain the entire set of human books, past and future, and alien books for that matter, along with the correct method to translate it. It would have every bit of knowledge possible to fit into a 2 dimensional representation written down for us to read right now.

    Which is all very exciting until you realise that it is, of course, not possible to do with computers in any meaningful timescale within a Universe, and for every correct set of blueprints for a time machine there must be an almost infinite set of incorrect ones which are indistinguishable from all the others until you build it.

    As an interesting aside, I wonder what size bitmap it IS capable for - 2X2? 4X4?