Difference between revisions of "Job management with LSF"

From ScientificComputing
Jump to: navigation, search
 
(8 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
<tr valign=top>
 
<tr valign=top>
 
<td style="width: 30%; text-align:left">
 
<td style="width: 30%; text-align:left">
< [[Modules_and_applications]]
+
< [[Modules and applications]]
 
</td>
 
</td>
 
<td style="width: 35%; text-align:center">
 
<td style="width: 35%; text-align:center">
[[Sandbox Home | Home]]
+
[[Main_Page | Home]]
 
</td>
 
</td>
 
<td style="width: 35%; text-align:right">
 
<td style="width: 35%; text-align:right">
Line 24: Line 24:
 
<td style="width: 5%;>
 
<td style="width: 5%;>
 
</td>
 
</td>
<td style="width: 40%; background: white; text-align: left;>
+
<td style="width: 35%; background: white; text-align: left;>
  
<div style="width: 60%; background: #B2D9EA; height: 35px; border-radius: 10px; padding: 5px; margin:5px">
+
<div style="background: #B2D9EA; text-align: left" class="button">
 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job submission|'''1. Submit a job''']]
 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job submission|'''1. Submit a job''']]
 
</div>
 
</div>
  
<div style="width: 60%; background:#B2D9EA; height: 35px; border-radius: 10px; padding: 5px; margin:5px">
+
<div style="background: #B2D9EA; text-align: left" class="button">
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Parallel job submission|'''2. Submit a parallel job''']]
+
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Parallel job submission|'''1.1 Submit a parallel job''']]
 
</div>
 
</div>
  
<div style="width: 60%; background: #B2D9EA; height: 35px; border-radius: 10px; padding: 5px; margin:5px">
+
<div style="background: #B2D9EA; text-align: left" class="button">
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job monitoring|'''3. Monitor a job''']]
+
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[GPU job submission|'''1.2 Submit a GPU job''']]
 
</div>
 
</div>
  
<div style="width: 60%; background: #B2D9EA; height: 35px; border-radius: 10px; padding: 5px; margin:5px">
+
<div style="background: #B2D9EA; text-align: left" class="button">
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job output |'''4. Job output''']]
+
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job monitoring|'''2. Monitor a job''']]
 
</div>
 
</div>
 +
 +
<div style="background: #B2D9EA; text-align: left" class="button">
 +
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[[Job output |'''3. Job output''']]
 +
</div>
 +
  
 
</td>
 
</td>
  
<td style="width: 20%; background: white; text-align: center;">
+
<td style="width: 30%; background: white; text-align: center;">
  
 
</td>
 
</td>
Line 54: Line 59:
 
== Why use the batch system? ==
 
== Why use the batch system? ==
 
Users can access the computing resources on the cluster solely through the batch system. On the ETH HPC clusters, we use the LSF batch system to manage computing jobs.
 
Users can access the computing resources on the cluster solely through the batch system. On the ETH HPC clusters, we use the LSF batch system to manage computing jobs.
 
== What are the steps? ==
 
* Log in to a login node on the cluster
 
* Transfer your data to the cluster
 
* Load necessary modules
 
* Prepare a BSUB command with LSF options which request the computing resources that you need
 
* Submit a job with a BSUB command line or a job script
 
* Wait for your job to run
 
* Your job is run on compute nodes
 
* Get your job results and output
 
  
  
Line 69: Line 64:
 
<tr valign=top>
 
<tr valign=top>
 
<td style="width: 30%; text-align:left">
 
<td style="width: 30%; text-align:left">
< [[Modules_and_applications]]
+
< [[Modules and applications]]
 
</td>
 
</td>
 
<td style="width: 35%; text-align:center">
 
<td style="width: 35%; text-align:center">
[[Sandbox Home | Home]]
+
[[Main_Page | Home]]
 
</td>
 
</td>
 
<td style="width: 35%; text-align:right">
 
<td style="width: 35%; text-align:right">

Latest revision as of 09:24, 1 October 2021

< Modules and applications

Home

Submit a job >


Batch system.png

     1. Submit a job

       1.2 Submit a GPU job

     2. Monitor a job

     3. Job output


Why use the batch system?

Users can access the computing resources on the cluster solely through the batch system. On the ETH HPC clusters, we use the LSF batch system to manage computing jobs.


< Modules and applications

Home

Submit a job >