Using node-local storage: Difference between revisions

Jump to navigation Jump to search
no edit summary
m (Rdickson moved page Using local scratch to Using node-local storage without leaving a redirect: Part of translatable page "Using local scratch")
No edit summary
Line 68: Line 68:
<!--T:15-->
<!--T:15-->
Copy one or more files to the <tt>SLURM_TMPDIR</tt> directory on every node allocated like this:
Copy one or more files to the <tt>SLURM_TMPDIR</tt> directory on every node allocated like this:
{{Command|pdcp -w $(slurm_hl2hl.py --format PDSH) file [files...] $SLURM_TMPDIR}}
{{Command|srun --ntasks{{=}}$SLURM_NNODES --ntasks-per-node{{=}}1 cp file [files...] $SLURM_TMPDIR}}
 
<!--T:16-->
Or use GNU Parallel to do the same:
{{Command|parallel -S $(slurm_hl2hl.py --format GNU-Parallel) --env SLURM_TMPDIR --workdir $PWD --onall cp file [files...] ::: $SLURM_TMPDIR}}


== Compressed Archives == <!--T:17-->
== Compressed Archives == <!--T:17-->
Line 80: Line 76:
<!--T:19-->
<!--T:19-->
Extract to the <tt>SLURM_TMPDIR</tt>:
Extract to the <tt>SLURM_TMPDIR</tt>:
{{Command|pdsh -w $(slurm_hl2hl.py --format PDSH) unzip archive.zip -d $SLURM_TMPDIR}}
{{Command|srun --ntasks{{=}}$SLURM_NNODES --ntasks-per-node{{=}}1 unzip archive.zip -d $SLURM_TMPDIR}}


=== Tarball === <!--T:20-->
=== Tarball === <!--T:20-->
Extract to the <tt>SLURM_TMPDIR</tt>:
Extract to the <tt>SLURM_TMPDIR</tt>:
{{Command|pdsh -w $(slurm_hl2hl.py --format PDSH) tar -xvf archive.tar.gz -C $SLURM_TMPDIR}}
{{Command|srun --ntasks{{=}}$SLURM_NNODES --ntasks-per-node{{=}}1 tar -xvf archive.tar.gz -C $SLURM_TMPDIR}}


= Amount of space = <!--T:21-->
= Amount of space = <!--T:21-->
Bureaucrats, cc_docs_admin, cc_staff, rsnt_translations
2,837

edits

Navigation menu