Slashdot Mirror


Open Source Distributed Shell Tools?

ColonelForbin74 asks: "While some may assume that most larger server clusters run advanced / custom software(i.e. Beowulf, cfengine, OSCAR), many of those stuck in the not-research-this-site-runs-production world know this simply isn't the case. Many people like myself are working with medium-to-large scale clusters with little help other than shell for() loops and some SSH trusted keys. What application-level tools are out there that might help SysAdmin / AppSupport types like myself run commands across a given cluster, push files out, etc? In my desperation to have some sort of tool in my toolbox, I've actually created one. However, I have a hard time believing this is the best thing out there, and would appreciate all the ideas and links I can get!"

7 of 31 comments (clear)

  1. Try this for a start by epsalon · · Score: 4, Informative

    A lecture from the Haifa Linux Club about the subject.

  2. The bitcluster tools are useful by Kraken137 · · Score: 5, Informative
  3. Whatever happened to... by Bandito · · Score: 4, Informative

    DSH? I used it awhile back and was pretty happy with it.

    It was a bit unstable, but that was almost a year ago. Give it a try.

  4. How about pdsh? by cinnerz · · Score: 4, Informative

    PDSH works pretty well in my experience. It's pretty good to run commands on the nodes and pdcp can copy files out.

  5. herdtools by MacJedi · · Score: 3, Informative
    herdtools

    /joeyo

    --
    2^5
  6. Rocks Cluster Distribution by tellurian · · Score: 3, Informative

    I like the Rocks Cluster Distribution. It is above all simple to use, well documented, and stable.

  7. SUN's grid engine by martin · · Score: 3, Informative

    is free for both solaris (Sparc & x86) and Linux..

    http://wwws.sun.com/software/gridware/sge_get.ht ml

    grid engines 'tend' to be more useful as they can balance the load better to non-dedicated hosts. Just my view, but saves building a dedicated cluster with all these 2ghz pentiums on the desktop..(assuming you have linux on the desktop of course)

    --