Difference between revisions of "Sandbox Home"

From ScientificComputing
Jump to: navigation, search
(→‎Quick guide)
(63 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
−
= Welcome to ETH Scientific and High Performance Computing Wiki =
+
=Welcome to the scientific computing wiki=
−
<table style="width: 100%;">
 
−
<tr valign=center>
 
−
<td style="width: 30%; background: white; text-align: left;">
 
−
[[Image:NvidiaDGX1_cropped1.jpg| 420px]]
 
−
</td>
 
−
<td style="width: 2%; background: white; text-align: left;>
 
−
</td>
 
−
<td style="width: 30%; background: white; text-align: left;>
 
  
 +
<table style="width: 95%; border-spacing: 20px;">
 +
<tr valign=top>
 +
<td style="width: 22%; text-align: left;">
 
=== Quick guide ===
 
=== Quick guide ===
 +
<div style="background: #BFE5D9;" class="button">
 +
[[Accessing the cluster| '''Accessing the cluster''']]
 +
</div>
 +
<div style="background: #BFE5D9;" class="button">
 +
[[Storage and data transfer| '''Storage and data transfer''']]
 +
</div>
 +
<div style="background: #BFE5D9;" class="button">
 +
[[Modules and applications | '''Modules and applications''']]
 +
</div>
 +
<div style="background: #BFE5D9;" class="button>
 +
[[Job management with LSF| '''Job management with LSF''' ]]
 +
</div>
 +
<div style="background: #BFE5D9;" class=button>
 +
[[running applications| '''Examples''']]
 +
</div>
 +
</td>
 +
<td style="width: 22%;>
  
−
<div style="width: 100%; background: #BFE5D9; border-radius: 10px; padding: 5px; margin:5px;">
+
=== Helpers and support ===
−
&emsp;[[Sandbox Accessing the clusters| '''1. Accessing the clusters''']]
+
<div style="background: #b2d9eac8;" class="button">
 +
[https://scicomp.ethz.ch/lsf_submission_line_advisor/ '''LSF Submission Line Advisor''']
 
</div>
 
</div>
−
 
+
<div style="background: #b2d9eac8;" class="button">
−
<div style="width: 100%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; padding-left:30px;">
+
[[FAQ|'''FAQ''']]
−
[[Storage and data transfer| '''2. Storage and data transfer''']]
 
 
</div>
 
</div>
−
 
+
<div style="background: #b2d9eac8;" class="button">
−
<div style="width: 100%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; padding-left:30px;">
+
[[Euler_applications_and_libraries|'''Applications overview''']]
−
[[Modules and applications | '''3. Modules and applications''']]
 
 
</div>
 
</div>
−
 
+
<div style="background: #b2d9eac8;" class="button">
−
<div style="width: 100%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; padding-left:30px;">
+
[http://smartdesk.ethz.ch '''Smartdesk''']
−
[[Job management with LSF| '''4. Job management with LSF''' ]]
 
 
</div>
 
</div>
−
 
+
<div style="background: #b2d9eac8;" class="button">
−
<div style="width: 100%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; padding-left:30px;">
+
[mailto:cluster-support@id.ethz.ch '''Cluster support''']
−
[[running applications| '''5. Tutorials''']]
 
 
</div>
 
</div>
 
</td>
 
</td>
−
<td style="width: 38%; background: white; text-align: left;>
+
<td style="width: 42%;" valign="middle" >[[Image:NvidiaDGX1_cropped1.jpg| 500px]]</td>
−
</td>
 
 
</tr>
 
</tr>
 
</table>
 
</table>
  
−
== [[News]] ==
+
==News==
−
<table style="width: 95%">
+
{{:News}}
−
<tr valign=top>
+
[[News|''More...'']]
−
<td style="width: 22%; background: white;">
 
−
[[New account request process for HPC clusters|'''New account request process for Euler and Leonhard Open''']]
 
−
 
 
−
14.01.2021
 
−
 
 
−
We are introducing a new automated process for obtaining an account for the HPC clusters of ETH, starting with Leonhard Open and later we also implement the same process on Euler. [[New account request process for HPC clusters|Read more...]]
 
−
</td>
 
−
<td style="width: 2%; background: white;">
 
−
</td>
 
−
<td style="width: 22%; background: white;">
 
−
[[Upcoming Euler VII expansion|'''Upcoming Euler VII expansion''']]
 
−
 
 
−
14.04.2020
 
−
 
 
−
The next major expansion of the Euler cluster — Euler VII — will be based on the same kind of compute nodes as Euler VI
 
−
[[Upcoming Euler VII expansion|Read more...]]
 
−
</td>
 
−
<td style="width: 2%; background: white;">
 
−
</td>
 
−
<td style="width: 22%; background: white;">
 
−
[[COVID-19|'''COVID-19 — Cluster operation during state of emergency at ETH''']]
 
−
 
 
−
17.03.2020
 
−
 
 
−
As announced by President Joël Mesot in the evening of March 16 (see email), ETH will be operating in a state of emergency starting today. Most employees are required to work from home. [[COVID-19|Read more...]]
 
−
 
 
−
</td>
 
−
<td style="width: 2%; background: white;">
 
−
</td>
 
−
<td style="width: 22%; background: white;">
 
−
[[Jupyter on Euler and Leonhard Open|'''Script to run a Jupyter notebook interactively in a batch job on Euler or Leonhard Open''']]
 
−
 
 
−
27.09.2019
 
−
 
 
−
Since Jupyter notebooks are becoming more widely used among the scientific community, the HPC group developed a script that you can run on your local computer. This shell script then starts a Jupyter notebook in a batch job on Euler/Leonhard Open (depending on which cluster you choose) and connects your local browser with it. [[Jupyter on Euler and Leonhard Open|Read more...]]
 
−
 
 
−
</td>
 
−
</tr>
 
−
</table>
 
  
 
==Most recent software installations==
 
==Most recent software installations==
 
Twenty most recent software installation on each cluster. The list is based on the last modification time of the module files.
 
Twenty most recent software installation on each cluster. The list is based on the last modification time of the module files.
 
{| style="width: 100%; text-align:left;"
 
{| style="width: 100%; text-align:left;"
−
! style="width: 50%"|Euler ('''new software stack''',[[Euler_applications_and_libraries|see complete list]]):
+
! style="width: 50%"|Euler ('''new software stack''', [[Euler_applications_and_libraries|see complete list]]):
−
! style="width: 50%"|Leonhard Open ([[Leonhard_applications_and_libraries|see complete list]]):
+
! style="width: 50%"|
 
|-
 
|-
 
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/euler" />
 
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/euler" />
−
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/leonhard" />
+
|<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/euler2" />
 
|}
 
|}
−
 
+
<include nopre wikitext src="/cluster/wiki/auto/spack_module_tables/recent/etimestamp" />
−
== Helpers ==
 
−
<table style="width: 95%">
 
−
<tr valign=top>
 
−
<td style="width: 30%; background: white;">
 
−
 
 
−
<div style="width: 50%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; text-align:center;">
 
−
LSF
 
−
</div>
 
−
</td>
 
−
 
 
−
<td style="width: 30%; background: white;">
 
−
<div style="width: 50%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; text-align:center;">
 
−
FAQ
 
−
 
 
−
</div>
 
−
</td>
 
−
 
 
−
<td style="width: 30%; background: white;">
 
−
<div style="width: 50%; background: #BFE5D9; height: 35px; border-radius: 10px; padding: 5px; margin:5px; text-align:center;">
 
−
Cluster Support
 
−
 
 
−
</div>
 
−
</td>
 
−
</tr>
 
−
</table>
 

Revision as of 09:11, 19 April 2022

Welcome to the scientific computing wiki

Quick guide

Accessing the cluster

Storage and data transfer

Modules and applications

Job management with LSF

Examples

Helpers and support

LSF Submission Line Advisor

FAQ

Applications overview

Smartdesk

Cluster support

NvidiaDGX1 cropped1.jpg

News

  • 23 Aug 2023 — Best Practices:
    Some recommendations on how to use the cluster most efficiently, which will reduce the stress on the system and speedup your throughput of jobs by improving your workflow.
  • 13 Jun 2023 — Cloud Service for Jupyterhub, RStudio and VSCode on Euler:
    We provide several cloud services through Jupyterhub, which allow to run Jupyter, RStudio and VSCode directly on Euler
  • 05 Aug 2022 — Transition from LSF to Slurm:
    Due to the significant increase in license cost over the past years, we will transition from IBM LSF to Slurm. Please check our LSF to Slurm quick reference.
  • 18 Mar 2022 — Using MPI on Euler:
    For running MPI jobs on Euler some configuration settings are required, which are documented on this wiki page.
  • 17 Feb 2022 — List of publications that mention the HPC clusters of ETH:
    On our scicomp wiki, we added a list of publications that reference the HPC clusters of ETH. If you mention the Euler cluster in your publication, then please let us know and we will add your publication to the list


More...

Most recent software installations

Twenty most recent software installation on each cluster. The list is based on the last modification time of the module files.

Euler (new software stack, see complete list):
trapproto/3.4.3 (gcc 11.4.0)
libxpresent/1.0.0 (gcc 11.4.0)
libxevie/1.0.3 (gcc 11.4.0)
evieext/1.1.1 (gcc 11.4.0)
bigreqsproto/1.1.2 (gcc 11.4.0)
fonttosfnt/1.2.2 (gcc 11.4.0)
dbus/1.13.6 (gcc 11.4.0)
libxxf86vm/1.1.4 (gcc 11.4.0)
libxres/1.0.7 (gcc 11.4.0)
libxcursor/1.2.1 (gcc 11.4.0)
libxtst/1.2.2 (gcc 11.4.0)
libxcomposite/0.4.6 (gcc 11.4.0)
xf86vidmodeproto/2.3.1 (gcc 11.4.0)
scrnsaverproto/1.2.2 (gcc 11.4.0)
recordproto/1.14.2 (gcc 11.4.0)
dmxproto/2.3.1 (gcc 11.4.0)
compositeproto/0.4.2 (gcc 11.4.0)
cairo/1.17.4 (gcc 11.4.0)
cairo/1.17.2 (gcc 11.4.0)
fontconfig/2.14.2 (gcc 11.4.0)

gperf/3.1 (gcc 11.4.0)
font-util/1.4.0 (gcc 11.4.0)
glib/2.76.4 (gcc 11.4.0)
xcb-util-keysyms/0.4.1 (gcc 11.4.0)
xcb-util-errors/1.0.1 (gcc 11.4.0)
xcb-util-cursor/0.1.4 (gcc 11.4.0)
xcb-util-image/0.4.1 (gcc 11.4.0)
xcb-util/0.4.1 (gcc 11.4.0)
xcb-util-wm/0.4.2 (gcc 11.4.0)
libxkbcommon/0.8.2 (gcc 11.4.0)
xkbdata/1.0.1 (gcc 11.4.0)
xkbcomp/1.4.4 (gcc 11.4.0)
googletest/1.12.1 (gcc 11.4.0)
libxp/1.0.3 (gcc 11.4.0)
printproto/1.0.5 (gcc 11.4.0)
libxi/1.7.7 (gcc 11.4.0)
swig/4.1.1 (gcc 11.4.0)
tmux/3.3a (gcc 11.4.0)
sparsehash/2.0.4 (gcc 11.4.0)
xhost/1.0.9 (gcc 11.4.0)

List of recently installed software has been updated on Fri Sep 29 10:08:29 CEST 2023

Retrieved from "https://scicomp.ethz.ch/w/index.php?title=Sandbox_Home&oldid=7394"