Difference between revisions of "Unified quota wrapper"

From ScientificComputing
Jump to: navigation, search
(Created page with "We have implemented a unified quota wrapper '''<tt>lquota</tt>''' that can be used to query the file systems space and inode (file or directory descriptor) quota on all file s...")
 
Line 1: Line 1:
 +
==Introduction==
 
We have implemented a unified quota wrapper '''<tt>lquota</tt>''' that can be used to query the file systems space and inode (file or directory descriptor) quota on all file systems on all clusters that we have:
 
We have implemented a unified quota wrapper '''<tt>lquota</tt>''' that can be used to query the file systems space and inode (file or directory descriptor) quota on all file systems on all clusters that we have:
  
Line 7: Line 8:
 
* /cluster/project (shareholder storage)
 
* /cluster/project (shareholder storage)
  
Please find below the documentation about this command:
+
==Documentation==
 +
You can display the documentation of the command by running it with the parameter <tt>-h</tt>:
  
 
  [leonhard@eu-login-07-ng ~]$ lquota -h
 
  [leonhard@eu-login-07-ng ~]$ lquota -h
Line 18: Line 20:
 
  [leonhard@eu-login-07-ng ~]$
 
  [leonhard@eu-login-07-ng ~]$
  
 +
There are space quotas and inode quotas. An inode is a data structure to organize data in a file system. Each file or directory has one inode. Therefore a quota for inodes actually means that you can only have a limited number of files and directories in a storage share. For the home directories, we use a quota of 100'000 inodes, which implies that you cannot have more than 100'000 files and directories in your home directory.
 +
 +
==Examples==
 
If the command is run without specifying a particular path, then it displays the quota for the home directory, the personal scratch directory and the shadow file system. If a path is specified as argument to the script, then it will display the inode and space quota for this particular storage share:
 
If the command is run without specifying a particular path, then it displays the quota for the home directory, the personal scratch directory and the shadow file system. If a path is specified as argument to the script, then it will display the inode and space quota for this particular storage share:
  

Revision as of 11:01, 4 March 2019

Introduction

We have implemented a unified quota wrapper lquota that can be used to query the file systems space and inode (file or directory descriptor) quota on all file systems on all clusters that we have:

  • /cluster/home/$USER ($HOME, home directory)
  • /cluster/scratch/$USER ($SCRATCH, personal scratch directory)
  • /cluster/shadow (buffering stdout of running batch jobs)
  • /cluster/work (shareholder storage)
  • /cluster/project (shareholder storage)

Documentation

You can display the documentation of the command by running it with the parameter -h:

[leonhard@eu-login-07-ng ~]$ lquota -h
/cluster/apps/local/lquota: Command to check share/directory/project quotas on distruted filesystems
Usage: quota [-h] [-k] [-v] [directory]
-h    display this help message and exit
-k    display all numbers in KB instead of the default human readable format
-v    show verbose output on quota for Lustre devices. Ignored for NFS
If "directory" is not specified user's home and scratch directory are used as argument
[leonhard@eu-login-07-ng ~]$

There are space quotas and inode quotas. An inode is a data structure to organize data in a file system. Each file or directory has one inode. Therefore a quota for inodes actually means that you can only have a limited number of files and directories in a storage share. For the home directories, we use a quota of 100'000 inodes, which implies that you cannot have more than 100'000 files and directories in your home directory.

Examples

If the command is run without specifying a particular path, then it displays the quota for the home directory, the personal scratch directory and the shadow file system. If a path is specified as argument to the script, then it will display the inode and space quota for this particular storage share:

[sfux@eu-login-10-ng ~]$ lquota
Disk quotas for user sfux (uid 40093): 
     Filesystem   space   quota   limit   grace   files   quota   limit   grace
eu-ne-home8:/home8
                  7134M  16384M  20480M           19916   80000    100k        
eu-ne-lsf:/shadow
                     4K   2048M   2048M               2   50000   50000        
-----------------------------------------------------------------------------------
Disk quotas for usr 40093 (uid 40093):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
/cluster/scratch//sfux
                   232k  2.273T  2.455T       -      29  1000000 1500000       -
[sfux@eu-login-10-ng ~]$ lquota /cluster/work/sis
Disk quotas for prj 34 (pid 34):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
/cluster/work/sis
                 7.392T  9.095T     10T       - 1141042  10000000 11000000       -
[sfux@eu-login-10-ng ~]$ lquota /cluster/project/sis
Filesystem                   Size  Used Avail Use% Mounted on
eu-ne-project2:/project/sis  9.5T  5.7T  3.9T  60% /cluster/project/sis
Filesystem                  Inodes IUsed IFree IUse% Mounted on
eu-ne-project2:/project/sis    31M  1.1M   30M    4% /cluster/project/sis

For the moment, you might need to use the full path /cluster/apps/local/lquota to run the script. We will add it to the users path soon, such that you will not have to use the full path.