Difference between revisions of "Euler"
(→Specifiations) |
|||
Line 7: | Line 7: | ||
Euler has been regularly expanded since its conception in 2013. The first phase — Euler I — was purchased at the end of 2013 and is in operation since the beginning of 2014. The second phase — Euler II — was purchased at the end of 2014 and is in operation since the beginning of 2015, with additional compute nodes added at the end of 2015. The third phase — Euler III — has just been ordered and is expected to be operational at the beginning of 2017. | Euler has been regularly expanded since its conception in 2013. The first phase — Euler I — was purchased at the end of 2013 and is in operation since the beginning of 2014. The second phase — Euler II — was purchased at the end of 2014 and is in operation since the beginning of 2015, with additional compute nodes added at the end of 2015. The third phase — Euler III — has just been ordered and is expected to be operational at the beginning of 2017. | ||
− | == | + | == Specifications == |
=== Euler I === | === Euler I === | ||
− | Euler I contains '''448''' compute nodes — Hewlett-Packard BL460c Gen8 —, each equipped with | + | Euler I contains '''448''' compute nodes — Hewlett-Packard BL460c Gen8 —, each equipped with: |
+ | |||
+ | * Two '''12-core''' [http://ark.intel.com/products/75283/ Intel Xeon E5-2697v2] processors (2.7 GHz nominal, '''3.0–3.5 GHz''' peak) | ||
+ | * Between 64 and 256 GB of DDR3 memory clocked at 1866 MHz (64 × 256 GB; 32 × 128 GB; 352 × 64 GB). | ||
=== Euler II === | === Euler II === | ||
− | Euler II contains '''768''' compute nodes of a newer generation — [https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.overview.hpe-proliant-bl460c-gen9-server-blade.7271227.html BL460c Gen9] —, each equipped with | + | Euler II contains '''768''' compute nodes of a newer generation — [https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.overview.hpe-proliant-bl460c-gen9-server-blade.7271227.html BL460c Gen9] —, each equipped with: |
+ | |||
+ | * Two 12-core [http://ark.intel.com/products/81908/ Intel Xeon E5-2680v3] processors (2.5-3.3 GHz) | ||
+ | * Between 64 and 512 GB of DDR4 memory clocked at 2133 MHz (32 × 512 GB; 32 × 256 GB; 32 × 128 GB; 672 × 64 GB). | ||
+ | |||
+ | Euler II also contains '''4''' very large memory nodes — Hewlett-Packard DL580c Gen9 —, each equipped with: | ||
+ | |||
+ | * Four 16-core [http://ark.intel.com/products/84681/ Intel Xeon E7-8867v3] processors (2.5 GHz) | ||
+ | * '''3072''' GB of DDR4 memory clocked at 2133 MHz. | ||
=== Euler III === | === Euler III === | ||
− | Euler III will consist of '''1215''' compute nodes — [https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.hpe-proliant-m710x-server-cartridge.1009011712.html Hewlett-Packard m710x] — each equipped with | + | Euler III will consist of '''1215''' compute nodes — [https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.hpe-proliant-m710x-server-cartridge.1009011712.html Hewlett-Packard m710x] —, each equipped with: |
+ | |||
+ | * A quad-core [http://ark.intel.com/products/93741/ Intel Xeon E3-1285Lv5] processor (3.0-3.7 GHz) | ||
+ | * 32 GB of DDR4 memory clocked at 2133 MHz | ||
+ | * A 256 GB NVMe flash drive | ||
+ | |||
+ | All these nodes are connected to the rest of the cluster via 10G/40G Ethernet. | ||
+ | |||
+ | === Storage === | ||
+ | |||
+ | Euler contains two storage system: | ||
+ | |||
+ | * An enterprise-class NAS system (NetApp FAS3250 and FAS8080EX) for long-term storage, such as home directories, applications, virtual machines, project data, etc. | ||
+ | * A high-performance parallel file system (Panasas PAS14) for short- and medium-term storage, such as scratch and work file systems | ||
+ | |||
+ | === Networks === | ||
+ | |||
+ | Euler contains two types of networks: | ||
+ | |||
+ | * A common 10 Gb/s Ethernet for data transfer between the storage systems and the cluster's compute and login nodes | ||
+ | * Three separate 56 Gb/s InfiniBand FDR for data transfer between the compute nodes themselves (e.g. MPI) | ||
== External Links == | == External Links == | ||
* https://www.ethz.ch/de/news-und-veranstaltungen/eth-news/news/2014/05/euler-mehr-power-fuer-die-forschung.html | * https://www.ethz.ch/de/news-und-veranstaltungen/eth-news/news/2014/05/euler-mehr-power-fuer-die-forschung.html | ||
* https://blogs.ethz.ch/id/2014/05/09/der-neue-hpc-cluster-euler-ist-verfugbar | * https://blogs.ethz.ch/id/2014/05/09/der-neue-hpc-cluster-euler-ist-verfugbar |
Revision as of 11:02, 13 October 2016
Contents
Introduction
Euler stands for Erweiterbarer, Umweltfreundlicher, Leistungsfähiger ETH-Rechner. It is an evolution of the Brutus concept. Euler also incorporates new ideas from the Academic Compute Cloud project in 2012–2013 as well as the Calculus prototype in 2013.
Euler has been regularly expanded since its conception in 2013. The first phase — Euler I — was purchased at the end of 2013 and is in operation since the beginning of 2014. The second phase — Euler II — was purchased at the end of 2014 and is in operation since the beginning of 2015, with additional compute nodes added at the end of 2015. The third phase — Euler III — has just been ordered and is expected to be operational at the beginning of 2017.
Specifications
Euler I
Euler I contains 448 compute nodes — Hewlett-Packard BL460c Gen8 —, each equipped with:
- Two 12-core Intel Xeon E5-2697v2 processors (2.7 GHz nominal, 3.0–3.5 GHz peak)
- Between 64 and 256 GB of DDR3 memory clocked at 1866 MHz (64 × 256 GB; 32 × 128 GB; 352 × 64 GB).
Euler II
Euler II contains 768 compute nodes of a newer generation — BL460c Gen9 —, each equipped with:
- Two 12-core Intel Xeon E5-2680v3 processors (2.5-3.3 GHz)
- Between 64 and 512 GB of DDR4 memory clocked at 2133 MHz (32 × 512 GB; 32 × 256 GB; 32 × 128 GB; 672 × 64 GB).
Euler II also contains 4 very large memory nodes — Hewlett-Packard DL580c Gen9 —, each equipped with:
- Four 16-core Intel Xeon E7-8867v3 processors (2.5 GHz)
- 3072 GB of DDR4 memory clocked at 2133 MHz.
Euler III
Euler III will consist of 1215 compute nodes — Hewlett-Packard m710x —, each equipped with:
- A quad-core Intel Xeon E3-1285Lv5 processor (3.0-3.7 GHz)
- 32 GB of DDR4 memory clocked at 2133 MHz
- A 256 GB NVMe flash drive
All these nodes are connected to the rest of the cluster via 10G/40G Ethernet.
Storage
Euler contains two storage system:
- An enterprise-class NAS system (NetApp FAS3250 and FAS8080EX) for long-term storage, such as home directories, applications, virtual machines, project data, etc.
- A high-performance parallel file system (Panasas PAS14) for short- and medium-term storage, such as scratch and work file systems
Networks
Euler contains two types of networks:
- A common 10 Gb/s Ethernet for data transfer between the storage systems and the cluster's compute and login nodes
- Three separate 56 Gb/s InfiniBand FDR for data transfer between the compute nodes themselves (e.g. MPI)