CHPC provides all PE users with a default 50 GB/user home directory space on the mammoth storage.
The size of a user's home directory space is enforced with a quota. There is a soft quota of 50GB and a hard quota of 75GB. Once a user's directory exceeds the soft quota, they have seven days to clean up and return to below the soft quota amount. After 7 days, they will no longer be able to write in their home directory until they clean up so that they are under the soft quota. If an user exceeds the hard quota, they immediately will no longer be able to write to their home directory until they clean up so they are not longer over this quota.
A more detailed description of the configuration of this storage offering is available (similar to the group space in the general environment)
This space is backed up on a schedule of nightly incremental with weekly full backups, with a two week retention window. CHPC does not offer larger home directories in the PE. Instead, users should make use of the project space to store data.
Project Level Storage File System
Also on the mammoth file system, CHPC provides each PE project with 250GB of project space at no cost. Each project has its own project space. Due to the NIH Shared Instrument Grant (SIG) that allowed for the new PE, PIs with NIH supported projects can, at no cost, request up to 5TB/project, with justification of need. Please note that this increased allocation of storage for NIH supported projects only applies to the storage purchased as part of the NIH SIG, and is only through the warranty lifetime of the hardware.
Any PI can purchase additional project space beyond these levels at the price of $150/TB (price based on hardware cost) for the lifetime of the hardware which is purchased with a 5 year warranty. CHPC will purchase additional project space as it is needed. Please contact us by emailing email@example.com to discuss the storage needs of your PE project.
Each project has its own project space. The access to this space is controlled by extended access controlled lists (ACLs) such that only users that are part of the project are allowed access to the space. For IRB governed projects, the users given access must be listed on the IRB. For non-IRB governed projects, the PI of the project will be consulted before CHPC gives any user access to the space.
At this time, the PE project spaces are being backed up once a week, with a two week retention window. This however will be changing as our current backup solution is not sustainable as the amount of project space grows. CHPC is currently exploring options new backup solutions.
Scratch File Systems
The PE scratch file system is /scratch/mammoth/serial with a capacity of 160T B THIS FILE SYSTEMS IS NOT BACKED UP. This space is provided for users to store intermediate files required during the duration of a job on the PE HPC cluster redwood. On these scratch file system, files that have not been accessed for 60 days are automatically scrubbed. There is no charge for use of the scratch space.
Archive Storage (Elm)
The archive storage is the same ceph solution discussed in the general storage page. With the erasure coding configuration being used, the price is$120/TB of usable capacity for the 5 year lifetime of the hardware. As we currently do with the project space, we will operate this space in a condominium model by reselling this space in TB chunks. This space is a stand alone entity, and will not be mounted on other CHPC resources.
The backup policies of each type of storage have been described above.
For more information on CHPC Data policies, visit: File Storage Policies