Slashdot Mirror


Implementing Better Task Scheduling for Servers?

trifakir asks: "We are running some quite expensive SunFire servers with Solaris 8. In the 'crontabs' of these hosts we have scheduled maybe some hundred odd jobs, which are constrained by multiple factors: dependencies on other jobs, time constrains, CPU and memory usage, network bandwidth, and so on. Obviously this imposes a CSP. On the other hand the number of these jobs, each one of them can take from minutes to hours is growing and we are now experiencing performance problems given the limited resources we have. Of course we have opened the bag-of-tricks with our best *ad-hoc* solutions, using mostly Open Source software, to turn our system into an event-based and less dependent on the scheduling expertise of the admins. At certain point we were considering using AutoSys and I was looking for a grid-like scheduler like OpenPBS, both of which were discarded for various reasons. I am curious, how you guys, would solve this problem, which seems very trivial for many environments. Both advice about theory (scheduling) and practice will help us and any other readers who may be tackling this difficult problem."

2 of 30 comments (clear)

  1. Re:My solution by Carnildo · · Score: 0, Offtopic

    How to rate this? The first sentence is clearly informative, the last few are clearly funny, but what about the rest?

    +sqrt(pi), Confused

    --
    "They redundantly repeated themselves over and over again incessantly without end ad infinitum" -- ibid.
  2. Re:OMFG!? by E_elven · · Score: 0, Offtopic

    Mod parent down :)

    --
    Marxist evolution is just N generations away!