Translations:Storage and file management/9/en
Jump to navigation
Jump to search
Best practices
- Only use text format for files that are smaller than a few megabytes.
- As far as possible, use local storage for temporary files. It is best to use the temporary directory created by the job scheduler for this, named
$SLURM_TMPDIR. - If your program must search within a file, it is fastest to do it by first reading it completely before searching, or to use a RAM disk.
- Regularly clean up your data in the scratch and project spaces, because those filesystems are used for huge data collections.
- If you no longer use certain files but they must be retained, archive and compress them, and if possible copy them elsewhere.
- If your needs are not well served by the available storage options please contact us by sending an e-mail to Compute Canada support.