Open Source Batch Management?
Asgard asks: "My employer is currently running a commercial batch management platform. Unfortunately the licensing model makes it unfeasible to run it in the development / testing environments, leading to poor usage of the tool and unexpected failures in production. I'm looking for an equivalent Open Source tool and am wondering how others have approached the problem. Does Slashdot have any suggestions?" Imagine a system like cron, but with job dependencies. Are there any batch systems out there like this?
"The tools I've found through web searches mostly treat 'batch management' from the cluster perspective -- a user submits an ad-hoc job and the tool figures out where and when to run it based on load and architecture requirements. Instead I am looking for something that manages daily schedules of jobs based on their dependencies with other jobs and external events, such as files arriving or time.
An example might be that every day jobs a, b, c, and d must run. Job a must not run before 9pm and requires file X to be present. Jobs b and c depend on a completing successfully. Job d must run after 2am and after b and c have completed successfully. If job c fails then an operator must fix the issue and rerun it, after which the tool will move on to job d. "
An example might be that every day jobs a, b, c, and d must run. Job a must not run before 9pm and requires file X to be present. Jobs b and c depend on a completing successfully. Job d must run after 2am and after b and c have completed successfully. If job c fails then an operator must fix the issue and rerun it, after which the tool will move on to job d. "
Back off, man -- he didn't mention having thought about using cron with a build system, so I suggested it. There was nothing else in the comments regarding an actual solution at the time, so I suggested an actual solution.
You attack my suggestion as being wasteful or suboptimal, but at the time I posted there were no solutions.
I hope it feels good to have pointed out the inadequacies of my attempt to provide some initial direction, especially given the fact that at the time I write this, 22 hours after the story hit the front page, there are still only 25 posts in the thread.
Have you suggested anything more useful than what my post mentioned, or are you just trying to be disagreeable?
Somebody get that guy an ambulance!
But slightly less in the dark than before I suggested trying cron and make, right? Then why attack my suggestion? Does it make you feel special?
Congratulations, you're special. Just like every other flamebaiting troll.
Somebody get that guy an ambulance!