Difference between revisions of "Migration of Euler scratch directories"

From ScientificComputing
Jump to: navigation, search
(Created page with "Since the underlying Panasas storage system is reaching its end-of-life, we were planning to migrate all users' scratch directories (/cluster/scratch/''username'') to a new Lu...")
 
m
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
Since the underlying Panasas storage system is reaching its end-of-life, we were planning to migrate all users' scratch directories (/cluster/scratch/''username'') to a new Lustre storage system over the coming months.
+
Since the underlying ''Panasas'' storage system is reaching its end-of-life, we were planning to migrate all users' '''scratch''' directories (/cluster/scratch/''username'') to a new ''Lustre'' storage system over the coming months.
  
The latest [[Euler_power_outage_(10_Aug_2018)|power outage at CSCS]] and the increasing risk of catastrophic failure of the Panasas system have forced us to '''accelerate''' this plan and to move all scratch directories at once. This migration started on 13 August while Euler was still off-line and was completed on 15 August.
+
The latest [[Euler_power_outage_(10_Aug_2018)|power outage at CSCS]] and the increasing risk of catastrophic failure of the Panasas system have forced us to '''accelerate''' this plan and to migrate all scratch directories '''at once'''. This process started on 13 August while Euler was still off-line and was completed on 15 August.
  
Except for a few hours when /cluster/scratch was accessible in read-only mode, the migration was done completely transparently. The new scratch directories are accessible under the same path as before.
+
Except for the ~30 hours when /cluster/scratch was accessible in '''read-only''' mode, the migration was done completely transparently. The new scratch directories are accessible under the '''same path''' as before, with the same permissions and quotas.
  
Due to the change of storage system from Panasas to Lustre, the command <tt>pan_quota</tt> cannot be used any more. You can use the following command to check your scratch usage & quotas:
+
Speaking about '''quotas''', the <tt>pan_quota</tt> command cannot be used any more. You can use the new <tt>scr_quota</tt> to check your scratch usage & quotas.
  
lfs quota `ls -d $SCRATCH`
+
Please contact {{cluster support}} if you notice any problem caused by the migration, like corrupted files or incorrect permissions.
 
 
We will provide a more user-friendly function shortly.
 

Latest revision as of 13:16, 15 August 2018

Since the underlying Panasas storage system is reaching its end-of-life, we were planning to migrate all users' scratch directories (/cluster/scratch/username) to a new Lustre storage system over the coming months.

The latest power outage at CSCS and the increasing risk of catastrophic failure of the Panasas system have forced us to accelerate this plan and to migrate all scratch directories at once. This process started on 13 August while Euler was still off-line and was completed on 15 August.

Except for the ~30 hours when /cluster/scratch was accessible in read-only mode, the migration was done completely transparently. The new scratch directories are accessible under the same path as before, with the same permissions and quotas.

Speaking about quotas, the pan_quota command cannot be used any more. You can use the new scr_quota to check your scratch usage & quotas.

Please contact cluster support if you notice any problem caused by the migration, like corrupted files or incorrect permissions.