Scratch purging policy: Difference between revisions

The scratch filesystem on Compute Canada clusters is intended as temporary, fast storage for data being used during job execution.  Data needed for long term storage and reference should be kept in either [[Project layout|<tt>/project</tt>]] or other archival storage areas. In order to ensure adequate space on scratch, older files are periodically deleted according to the policy outlined in this page. The threshold for purging is 60 days, which is a little more than twice the maximum duration of a job on the cluster. Note that the purging of a file is based on its age, not its location within scratch; simply moving a file from one directory in scratch to another directory in scratch will not in general prevent it from being purged.