Storage Quotas for Projects

Hard quotas have been set to approved storage allocations for projects. This encourages system users to run their jobs in /scratch and move/copy only the directories/files needed for project to /projects.

Storage quotas are based on a fiscal year's project resource allocations. They are implemented using the project group name assigned to each project, so users in multiple groups won't impact other projects' quotas. 

How To Determine Storage Quota Usage

To determine your quota usage, run the lfs quota -gh <projectname> /projects command. For example:

$ lfs quota -gh compsci /projects
Disk quotas for grp compsci (gid 123456):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
      /projects  10.61T     20T   20.1T       - 1064760       0       0       -
gid 123456 is using default file quota setting

An asterisk(*) indicates the project has exceeded its quota of storage, and writes to /projects/csc000 are not allowed.

What To Do if You Exceed a Storage Quota

If you exceed your storage quota, you have several options:

1. Remove any unneeded files and directories from your project.

2. Tar and compress files/directories from your project.

   Because writes are suspended, you can use your /scratch subdirectory to tar and zip the files, remove them from /projects, then copy the tar-zipped file to /projects. (Replace username, projectname, and directories/files to fit your needs):
    
   tar czvf /scratch/username/projectname-username-files-20201001.tgz /projects/projectname/<Directories-files-to-tar-and zip>
   
   Verify the files:
   cd /scratch/username
   tar xzvf projectname-username-files-20201001.tgz
   (verify)
   rm /projects/projectname/<Directories-files-to-tar-and zip>
   
   mv /scratch/username/ projectname-username-files-20201001.tgz /projects/projectname/projectname-username-files-20201001.tgz

3. Tar and compress files, copy/move them to MSS, and then remove them from the project directory.

   To request additional storage for your project, have the principal investigator or one of the HPC project leads submit a ticket to HPC-Help@nlr.gov with the project name, additional storage required in TB, and a justification for the increase.
   
   If your additional storage needs are temporary, please outline the capacity and length of time the project needs the temporary space.