New scratch filesystem for Euler

From ScientificComputing
Revision as of 08:18, 6 April 2021 by Sfux (talk | contribs)

Jump to: navigation, search

Introduction

Up to now, the personal scratch directories (/cluster/scratch/$USER) and the work storage shares (/cluster/work/) were hosted on the same Lustre file system in Euler. By adding a new DDN SFA400NVX Lustre filesystem for the personal scratch directories, these two types of storage are now separated. The new Lustre file system is based on very fast NVMe SSDs and can deliver an impressive sequential read performance of up to 48GB/s and a sequential write performance of up to 40 GB/s.

Migration of users personal scratch directories

The migration of the users scratch directory is transparent.

  • New scratch directories will be created on the new filesystem
  • Existing directories will be migrated

The new file system will have the same paths as the old one, therefore no action needs to be taken on the users side. There is no service interruption expected.

Troubleshooting

Performance issues

In case you encounter performance issues with the new scratch file system, please contact cluster-support@id.ethz.ch