cc_staff
318
edits
Handling large collections of files: Difference between revisions
Handling large collections of files (view source)
Revision as of 17:02, 21 February 2020
, 4 years agono edit summary
mNo edit summary |
No edit summary |
||
| Line 57: | Line 57: | ||
tar -cf ~/projects/def-foo/johndoe/results.tar work | tar -cf ~/projects/def-foo/johndoe/results.tar work | ||
}} | }} | ||
== RAM disk == | |||
The <code>/tmp</code> file system can be used as a RAM disk on the compute nodes. It is implemented using [https://en.wikipedia.org/wiki/Tmpfs tmpfs]. Here is more information | |||
* <code>/tmp</code> is <code>tmpfs</code> on all clusters | |||
* /tmp is cleared at job end | |||
* like all of a job's other memory use, falls under the cgroup limit corresponding to the sbatch request | |||
* we set the tmpfs size via mount options at 100%, which could potentially confuse some scripts, since it means /tmp's size is shown as the node's MemTotal. For example, df reports /tmp size as the physical RAM size, which does not correspond to the sbatch request | |||
==Archiving == <!--T:8--> | ==Archiving == <!--T:8--> | ||