Bureaucrats, cc_docs_admin, cc_staff
2,879
edits
Handling large collections of files: Difference between revisions
Jump to navigation
Jump to search
→Using the local disk
(→Using the local disk: remove unnecessary copies) |
|||
| Line 26: | Line 26: | ||
cd $SLURM_TMPDIR | cd $SLURM_TMPDIR | ||
mkdir | mkdir inputs | ||
cd | mkdir results | ||
cd inputs | |||
tar -xf ~/projects/def-foo/johndoe/my_data.tar | tar -xf ~/projects/def-foo/johndoe/my_data.tar | ||
# Now do my computations here on the local disk using the contents of the extracted archive... | # Now do my computations here on the local disk using the contents of the extracted archive... | ||
| Line 33: | Line 34: | ||
# The computations are done, so clean up the data set... | # The computations are done, so clean up the data set... | ||
cd $SLURM_TMPDIR | cd $SLURM_TMPDIR | ||
tar -cf ~/projects/def-foo/johndoe/results.tar | tar -cf ~/projects/def-foo/johndoe/results.tar results | ||
}} | }} | ||