Gnu parallel/Example

From ScientificComputing
Revision as of 07:21, 9 January 2017 by Sfux (talk | contribs)

Jump to: navigation, search

As an example for GNU parallel we are printing out all combinations of the letters A,B and C with D, E and F in parallel.

[leonhard@euler07 ~]$ module load new gcc/4.8.2 gnu_parallel/20140622
[leonhard@euler07 ~]$ bsub -n 2 -W 0:10 -R "rusage[mem=20]" "parallel echo ::: A B C ::: D E F"
Generic job.
Job <35259068> is submitted to queue <normal.4h>.
[leonhard@euler07 ~]$ bjobs
JOBID      USER       STAT  QUEUE      FROM_HOST   EXEC_HOST   JOB_NAME   SUBMIT_TIME
35259068   leonhard   PEND  normal.4h  euler07                 *::: D E F Jan  9 08:13
[leonhard@euler07 ~]$ bjobs
JOBID      USER       STAT  QUEUE      FROM_HOST   EXEC_HOST   JOB_NAME   SUBMIT_TIME
35259068   leonhard   RUN   normal.4h  euler07     e2121       *::: D E F Jan  9 08:13
[leonhard@euler07 ~]$ bjobs
No unfinished job found
[leonhard@euler07 ~]$ tail -n 9 lsf.o35259068 
A D
B D
B F
C E
A E
C F
B E
A F
C D

You can find the resource usage summary in the corresponding LSF log file for the job.