On 21Jan2022 10:39, linux guy <linuxguy123(a)gmail.com> wrote:
I'm using a server to run a bunch of simulations. By bunch I
mean
hundreds. Each simulation takes from 10 minutes to 10 hours to run. All
of the simulations are run from the command line. Every day I generate
more simulation cases.
I'm looking for a method/system/app that I can give a list of tasks that
will run them on the server, automatically, one after another.
If you can define a task in a single line of text you could run
something like this on the server:
tail -f task_list.txt | while read -r spec; do run the task from $spec; done
Put that in a tmux or screen session.
Task submission is then just appending a spec to the text file:
echo "specification here" >> task_list.txt
Dumb as rocks, but effective. I've run simple workers like this.
Probably "run the task from $spec" should invoke a shell script to run
exactly one task collecting the output, logging the times etc.
Cheers,
Cameron Simpson <cs(a)cskk.id.au>