Bureaucrats, cc_docs_admin, cc_staff
2,879
edits
Scratch purging policy: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
|||
| Line 3: | Line 3: | ||
=Overview= | =Overview= | ||
The scratch filesystem on Compute Canada clusters is intended as temporary, fast storage for data being used during job execution. Data needed for long term storage and reference should be kept in either project or other archival storage areas. In order to ensure adequate space on scratch older files are periodically deleted according to the policy outlined in this page. The threshold for purging is 60 days, which is a little more than twice the maximum duration of a job on the cluster. | The scratch filesystem on Compute Canada clusters is intended as temporary, fast storage for data being used during job execution. Data needed for long term storage and reference should be kept in either [[Project layout|<tt>/project</tt>]] or other archival storage areas. In order to ensure adequate space on scratch older files are periodically deleted according to the policy outlined in this page. The threshold for purging is 60 days, which is a little more than twice the maximum duration of a job on the cluster. | ||
The determination of a file's age is done by checking the most recent value between the access time (<tt>atime</tt>) and change time (<tt>ctime</tt>) of the file. You can find the <tt>ctime</tt> of a file using | The determination of a file's age is done by checking the most recent value between the access time (<tt>atime</tt>) and change time (<tt>ctime</tt>) of the file. You can find the <tt>ctime</tt> of a file using | ||