Job submission

From ScientificComputing
Revision as of 12:38, 21 January 2021 by Jarunanp (talk | contribs)

Jump to: navigation, search

Basic job submission

A basic BSUB job submission command consists of three parts:

bsub LSF options job
  1. The BSUB executable command
  2. LSF options requesting resources and defining job-related options
  3. A job to be submitted

Here is an example:

bsub -n 4 -W 4:00 -R "rusage[mem=4096]" "python"


A job can be one of the following:

Job Command Examples of job submission command
a single Linux command cmd
a program with its path /path/to/myprogram bsub ./bin/hello
a command or program with its arguments cmd arg1 arg2 bsub echo hello
multiple commands "cmd1 ; cmd2" bsub "date; pwd; ls -l"
piped command "cmd1 | cmd2"
a command with I/O redirection, quote "cmd<in >out" bsub "du -sk/scratch > du.out"
a here document, passed via "<<" << EOF ... EOF
a shell script, passed via "<" < script bsub <

LSF options

Requesting resources

Resources Format Default values
Maximum run time -W HH:MM 04:00 (4 hours)
Number of processors -n nprocs 1 processor
Memory -R "rusage[mem=2048]" 1024 MB per core
Scratch space -R "rusage[scratch=10000]"

Other LSF options

-o outfile append job’s standard output to outfile
-e errfile append job’s error messages to errfile
-R "rusage[...]" advanced resource requirement (memory,...)
-J jobname assign a jobname to the job
-w "depcond" wait until dependency condition is satisfied
-Is submit an interactive job with pseudo-terminal
-B /-N send an email when the job begins/ends
-u user@domain use this address instead of

Job script and #BSUB pragmas

Create a job script called job_script.bsub

#BSUB -n 24                     # 24 cores
#BSUB -W 8:00                   # 8-hour run-time
#BSUB -R "rusage[mem=4000]"     # 4000 MB per core
#BSUB -J analysis1
#BSUB -o analysis1.out
#BSUB -e analysis1.err

module load gcc/6.3.0 openmpi/3.0.2
cd /path/to/execution/folder
mpirun myprogram arg1

Submit a job

bsub < job_script.bsub

Job array

Lightweight jobs

Light-weight jobs are jobs that do not consume a lot of CPU time, for example

  • Master process in some type of parallel jobs
  • File transfer program
  • Interactive shell
bsub -n 4 -W 4:00 -R "rusage[mem=4096]" -Is bash


Submit a 15-minute interactive bash shell and logout (type “logout” or “exit”) when you’re done.

[sfux@eu-login-03 ~]$ bsub-W 15 -Is -R light /bin/bash
Generic job.
Job <27877012> is submitted to queue <light.5d>.
<<Waiting for dispatch ...>>
<<Starting on eu-c7-133-05>>

[sfux@eu-c7-133-05 ~]$ pwd/cluster/home/sfux
[sfux@eu-c7-133-05 ~]$ hostname
[sfux@eu-c7-133-05 ~]$ exit
[sfux@eu-login-03 ~]$