Difference between revisions of "New scratch filesystem for Euler"

From ScientificComputing
Jump to: navigation, search
(Created page with "==Introduction== Up to now, the personal scratch directory (/cluster/scratch/$USER) and the work storage shares (/cluster/work/) were hosted on the same Lustre file system. By...")
 
Line 1: Line 1:
 
==Introduction==
 
==Introduction==
Up to now, the personal scratch directory (/cluster/scratch/$USER) and the work storage shares (/cluster/work/) were hosted on the same Lustre file system. By adding a new Lustre filesystem for the personal scratch directories, these two types of storage are now separated.
+
Up to now, the personal scratch directory (<tt>/cluster/scratch/$USER</tt>) and the work storage shares (<tt>/cluster/work/</tt>) were hosted on the same Lustre file system in Euler. By adding a new DDN SFA400NVX Lustre filesystem for the personal scratch directories, these two types of storage are now separated. The new Lustre file system is based on very fast NVMe SSDs and can deliver an impressive sequential read performance of up to 48GB/s and a sequential write performance of up to 40 GB/s.  
  
 
==Migration of users personal scratch directories==
 
==Migration of users personal scratch directories==
The migration of the users scratch directory is transparent and the new scratch file system will have the same paths as the old one. Therefore no action needs to be taken on the users side.
+
The migration of the users scratch directory is transparent. New scratch directories will be created on the new filesystem and existing directories will be migrated. The new file system will have the same paths as the old one. Therefore no action needs to be taken on the users side.
  
 
==Troubleshooting==
 
==Troubleshooting==
 
===Performance issues===
 
===Performance issues===
 
In case you encounter performance issues with the new scratch file system, please contact cluster-support@id.ethz.ch
 
In case you encounter performance issues with the new scratch file system, please contact cluster-support@id.ethz.ch

Revision as of 08:16, 6 April 2021

Introduction

Up to now, the personal scratch directory (/cluster/scratch/$USER) and the work storage shares (/cluster/work/) were hosted on the same Lustre file system in Euler. By adding a new DDN SFA400NVX Lustre filesystem for the personal scratch directories, these two types of storage are now separated. The new Lustre file system is based on very fast NVMe SSDs and can deliver an impressive sequential read performance of up to 48GB/s and a sequential write performance of up to 40 GB/s.

Migration of users personal scratch directories

The migration of the users scratch directory is transparent. New scratch directories will be created on the new filesystem and existing directories will be migrated. The new file system will have the same paths as the old one. Therefore no action needs to be taken on the users side.

Troubleshooting

Performance issues

In case you encounter performance issues with the new scratch file system, please contact cluster-support@id.ethz.ch