Difference between revisions of "Storage systems"

From ScientificComputing
Jump to: navigation, search
Line 28: Line 28:
 
<noinclude>==External storage==</noinclude><includeonly>===External storage===</includeonly>
 
<noinclude>==External storage==</noinclude><includeonly>===External storage===</includeonly>
 
<noinclude>===Central NAS===</noinclude><includeonly>====Central NAS====</includeonly>
 
<noinclude>===Central NAS===</noinclude><includeonly>====Central NAS====</includeonly>
Provide list of requirements
+
* Mountable via NFS
 +
* Export to Euler subnet
 +
* Contact Systemdienste
 
<noinclude>===Local NAS===</noinclude><includeonly>====Local NAS====</includeonly>
 
<noinclude>===Local NAS===</noinclude><includeonly>====Local NAS====</includeonly>
 
* NFSv3
 
* NFSv3

Revision as of 16:52, 30 August 2016

Introduction

On our cluster, we provide multiple storage systems, which are optimized for different purposes. Since the available storage space on our clusters is limited and shared between all users, we set quotas in order to prevent single users from filling up an entire storage system with their data.

A summary of general questions about file systems, storage and file transfer can be found in our FAQ. If you have questions or encounter problems with the storage systems provided on our clusters or file transfer, then please contact cluster support.

Personal storage (everyone)

Home

On our clusters, we provide a home directory (folder) for every user that can be used for safe long term storage of important and critical data (program source, script, input file, etc.). It is created on your first login to the cluster and accessible through the path

/cluster/home/username

The path is also saved in the variable $HOME. The permissions are set that only you can access the data in your home directory and no other user. Your home directory is limited to 16 GB and a maximum of 100'000 files and directories (inodes). The content of your home is saved every hour and there is also a nightly backup (tape).

Scratch

We also provide a personal scratch directory (folder) for every user, that can be used for short-term storage of larger amounts of data

Group storage (sharholders only)

Project

Work

Local scratch (on each compute node)

/scratch
$TMPDIR

External storage

Central NAS

  • Mountable via NFS
  • Export to Euler subnet
  • Contact Systemdienste

Local NAS

  • NFSv3
  • NETHZ user names and groups
  • Export to Euler subnet (put example for export file), check if load balancer is part of the Euler subnet.

Comparison

Put table from presentation here

Choosing the optimal storage system

File transfer

Command line tools

Graphical tools

Quotas