Package for running jobs on Sun Grid Engine (SGE) / PBS / Slurm clusters.
- Provide an easy way to submit batch jobs from within a Jupyter notebook running on one of the nodes in the cluster.
from jobsubmitter import JobOpts, JobSubmitter
JOB_ID = 'job_0'
ENV = {
'PATH': '/home/kimlab1/strokach/anaconda/bin:/usr/local/bin:/usr/bin:/bin',
'OMP_NUM_THREADS': '1',
}
jo = jobsubmitter.JobOpts(
job_id=JOB_ID,
working_dir=Path.cwd(),
nproc=1,
queue='medium',
walltime='24:00:00',
mem='16G',
env=ENV,
)
js = jobsubmitter.JobSubmitter('localhost')
futures = js.submit(system_commands, jo, deplay=0.1)- Make sure all tests pass before merging into master.
- Follow the PEP8 / PyFlake / Flake8 / etc. guidelines.
- Add tests for new code.
- Try to document things.
- Break any / all of the above if you have a good reason.