Difference between revisions of "Sandbox Home"

From ScientificComputing
Jump to: navigation, search
(107 intermediate revisions by 3 users not shown)
Line 1: Line 1:
−
= Welcome to ETH High Performance Computing Cluster Wiki =
+
__NOTOC__
−
<table style="width: 100%;">
+
=Welcome to the scientific computing wiki=
−
<tr valign=center>
 
−
<td style="width: 30%; background: white; text-align: left;">
 
−
[[Image:NvidiaDGX1_cropped1.jpg|center | 350px]]
 
−
</td>
 
−
<td style="width: 2%; background: white; text-align: left;>
 
−
</td>
 
−
<td style="width: 65%; background: white; text-align: left;>
 
−
This wiki is to provide the cluster users with the information about the ETH HPC clusters and services which are operated and maintained by [[About us|the HPC group]] of [https://sis.id.ethz.ch/ ID Scientific IT Services].
 
  
−
[[Sandbox_User_documentation#Getting_started_with_clusters|Get started with the clusters!]]<br />
+
<table style="width: 95%; border-spacing: 20px;">
−
&nbsp;1. [[Sandbox Accessing the clusters|Accessing the clusters]]<br />
 
−
&nbsp;2. [[Storage and data transfer|Storage and data transfer]]<br />
 
−
&nbsp;3. [[Modules and applications | Modules and applications]]<br />
 
−
&nbsp;4. [[Job management with LSF]]<br />
 
−
&nbsp;5. [[running applications|Tutorials]]<br />
 
−
</td>
 
−
</tr>
 
−
</table>
 
−
== [[News]] ==
 
−
<table style="width: 95%">
 
 
<tr valign=top>
 
<tr valign=top>
−
<td style="width: 22%; background: white;">
+
<td style="width: 22%; text-align: left;">
−
[[New account request process for HPC clusters|'''New account request process for Euler and Leonhard Open''']]
+
=== Quick guide ===
−
 
+
<div style="background: #BFE5D9;" class="button">
−
14.01.2021
+
[[Accessing the cluster| '''Accessing the cluster''']]
−
 
+
</div>
−
We are introducing a new automated process for obtaining an account for the HPC clusters of ETH, starting with Leonhard Open and later we also implement the same process on Euler. [[New account request process for HPC clusters|Read more...]]
+
<div style="background: #BFE5D9;" class="button">
−
</td>
+
[[Storage and data transfer| '''Storage and data transfer''']]
−
<td style="width: 2%; background: white;">
+
</div>
−
</td>
+
<div style="background: #BFE5D9;" class="button">
−
<td style="width: 22%; background: white;">
+
[[Modules and applications | '''Modules and applications''']]
−
[[Upcoming Euler VII expansion|'''Upcoming Euler VII expansion''']]
+
</div>
−
 
+
<div style="background: #BFE5D9;" class="button>
−
14.04.2020
+
[[Job management with LSF| '''Job management with LSF''' ]]
−
 
+
</div>
−
The next major expansion of the Euler cluster — Euler VII — will be based on the same kind of compute nodes as Euler VI
+
<div style="background: #BFE5D9;" class=button>
−
[[Upcoming Euler VII expansion|Read more...]]
+
[[running applications| '''Examples''']]
−
</td>
+
</div>
−
<td style="width: 2%; background: white;">
 
 
</td>
 
</td>
−
<td style="width: 22%; background: white;">
+
<td style="width: 22%;>
−
[[COVID-19|'''COVID-19 — Cluster operation during state of emergency at ETH''']]
 
−
 
 
−
17.03.2020
 
−
 
 
−
As announced by President Joël Mesot in the evening of March 16 (see email), ETH will be operating in a state of emergency starting today. Most employees are required to work from home. [[COVID-19|Read more...]]
 
−
 
 
−
</td>
 
−
<td style="width: 2%; background: white;">
 
−
</td>
 
−
<td style="width: 22%; background: white;">
 
−
[[Jupyter on Euler and Leonhard Open|'''Script to run a Jupyter notebook interactively in a batch job on Euler or Leonhard Open''']]
 
−
 
 
−
27.09.2019
 
−
 
 
−
Since Jupyter notebooks are becoming more widely used among the scientific community, the HPC group developed a script that you can run on your local computer. This shell script then starts a Jupyter notebook in a batch job on Euler/Leonhard Open (depending on which cluster you choose) and connects your local browser with it. [[Jupyter on Euler and Leonhard Open|Read more...]]
 
  
 +
=== Helpers and support ===
 +
<div style="background: #b2d9eac8;" class="button">
 +
[https://scicomp.ethz.ch/lsf_submission_line_advisor/ '''LSF Submission Line Advisor''']
 +
</div>
 +
<div style="background: #b2d9eac8;" class="button">
 +
[[FAQ|'''FAQ''']]
 +
</div>
 +
<div style="background: #b2d9eac8;" class="button">
 +
[[Euler_applications_and_libraries|'''Applications overview''']]
 +
</div>
 +
<div style="background: #b2d9eac8;" class="button">
 +
[http://smartdesk.ethz.ch '''Smartdesk''']
 +
</div>
 +
<div style="background: #b2d9eac8;" class="button">
 +
[mailto:cluster-support@id.ethz.ch '''Cluster support''']
 +
</div>
 
</td>
 
</td>
 +
<td style="width: 42%;" valign="middle" >[[Image:NvidiaDGX1_cropped1.jpg| 500px]]</td>
 
</tr>
 
</tr>
 
</table>
 
</table>
  
−
== Clusters & Servers ==
+
==News==
−
{|class="wikitable" style="text-align: center; width: 45%;"
+
{{:News}}
−
! style="width:20%;"|[[Euler|Euler]]
+
[[News|''More...'']]
−
! style="width:20%;"|[[Leonhard|Leonhard Open]]
 
−
! style="width:20%;"|[[Leonhard|Leonhard Med]]
 
−
! style="width:20%;"|[[MATLAB_distributed_computing_server|MATLAB server]]
 
−
! style="width:20%;"|[[CLC_genomics_server|CLC genomics server]]
 
−
|-
 
−
|<include nopre wikitext src="/cluster/wiki/auto/service_status/euler_status"/>
 
−
|<include nopre wikitext src="/cluster/wiki/auto/service_status/leonhard_open_status"/>
 
−
|<include nopre wikitext src="/cluster/wiki/auto/service_status/leonhard_med_status"/>
 
−
|<include nopre wikitext src="/cluster/wiki/auto/service_status/calculus_status"/>
 
−
|<include nopre wikitext src="/cluster/wiki/auto/service_status/clc_status"/>
 
−
|}
 
  
−
{|
+
==Most recent software installations==
−
| '''Green'''
+
Twenty most recent software installation on each cluster. The list is based on the last modification time of the module files.
−
|:  
+
{| style="width: 100%; text-align:left;"
−
|Service is '''fully operational'''
+
! style="width: 50%"|Euler ('''new software stack''', [[Euler_applications_and_libraries|see complete list]]):
−
|-
+
! style="width: 50%"|
−
|'''Orange'''
 
−
|:  
 
−
|Service is '''partially operational''' or still in '''beta testing phase'''
 
 
|-
 
|-
−
|'''Red'''
+
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/euler" />
−
|:
+
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/euler2" />
−
|Service is '''unavailable'''
 
 
|}
 
|}
 +
<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/etimestamp" />

Revision as of 09:11, 19 April 2022

Welcome to the scientific computing wiki

Quick guide

Accessing the cluster

Storage and data transfer

Modules and applications

Job management with LSF

Examples

Helpers and support

LSF Submission Line Advisor

FAQ

Applications overview

Smartdesk

Cluster support

NvidiaDGX1 cropped1.jpg

News

  • 23 Aug 2023 — Best Practices:
    Some recommendations on how to use the cluster most efficiently, which will reduce the stress on the system and speedup your throughput of jobs by improving your workflow.
  • 13 Jun 2023 — Cloud Service for Jupyterhub, RStudio and VSCode on Euler:
    We provide several cloud services through Jupyterhub, which allow to run Jupyter, RStudio and VSCode directly on Euler
  • 05 Aug 2022 — Transition from LSF to Slurm:
    Due to the significant increase in license cost over the past years, we will transition from IBM LSF to Slurm. Please check our LSF to Slurm quick reference.
  • 18 Mar 2022 — Using MPI on Euler:
    For running MPI jobs on Euler some configuration settings are required, which are documented on this wiki page.
  • 17 Feb 2022 — List of publications that mention the HPC clusters of ETH:
    On our scicomp wiki, we added a list of publications that reference the HPC clusters of ETH. If you mention the Euler cluster in your publication, then please let us know and we will add your publication to the list


More...

Most recent software installations

Twenty most recent software installation on each cluster. The list is based on the last modification time of the module files.

Euler (new software stack, see complete list):
findutils/4.9.0 (gcc 11.4.0)
help2man/1.49.3 (gcc 11.4.0)
jdk/8u141-b15 (gcc 11.4.0)
libx11/1.7.5 (gcc 11.4.0)
kbproto/1.0.7 (gcc 11.4.0)
libxcb/1.14 (gcc 11.4.0)
xcb-proto/1.15.2 (gcc 11.4.0)
libogg/1.3.5 (gcc 11.4.0)
lzma/4.32.7 (gcc 11.4.0)
libfs/1.0.9 (gcc 11.4.0)
libtiff/4.5.1 (gcc 11.4.0)
libjpeg-turbo/2.0.6 (gcc 9.3.0)
libjpeg-turbo/3.0.0 (gcc 11.4.0)
nasm/2.15.05 (gcc 11.4.0)
libjpeg/9d (gcc 9.3.0)
libjpeg/9e (gcc 11.4.0)
bdw-gc/8.2.4 (gcc 11.4.0)
libatomic-ops/7.8.0 (gcc 11.4.0)
fontsproto/2.1.3 (gcc 11.4.0)
libpciaccess/0.17 (gcc 11.4.0)

libfontenc/1.1.7 (gcc 11.4.0)
sqlite/3.42.0 (gcc 11.4.0)
fontcacheproto/0.1.3 (gcc 11.4.0)
libxdmcp/1.1.4 (gcc 11.4.0)
libxau/1.0.8 (gcc 11.4.0)
openmd/2.6 (gcc 8.2.0, openmpi 4.1.4)
bolt-lmm/2.4.1 (intel 19.1.0)
nlopt/2.7.0 (intel 19.1.0)
inputproto/2.3.2 (gcc 11.4.0)
xextproto/7.3.0 (gcc 11.4.0)
libpthread-stubs/0.4 (gcc 11.4.0)
gperftools/2.13 (gcc 11.4.0)
libunwind/1.6.2 (gcc 11.4.0)
gperf/3.0.4 (gcc 11.4.0)
bash/5.2 (gcc 11.4.0)
libsm/1.2.3 (gcc 11.4.0)
libuuid/1.0.3 (gcc 11.4.0)
libice/1.0.9 (gcc 11.4.0)
xtrans/1.4.0 (gcc 11.4.0)
xproto/7.0.31 (gcc 11.4.0)

List of recently installed software has been updated on Fri Sep 22 16:06:28 CEST 2023

Retrieved from "https://scicomp.ethz.ch/w/index.php?title=Sandbox_Home&oldid=7394"