Niagara Quickstart: Difference between revisions

Niagara Quickstart (view source)

773 bytes removed , 6 years ago

no edit summary

cc_staff

290

edits

@@ Line 167: / Line 167: @@
 Details of how to use the datamover nodes can be found on the [[Data_Management#Moving_data | Data Management ]] page.
-== I/O Tips == <!--T:95-->
-<!--T:96-->
-* $HOME, $SCRATCH, and $PROJECT all use the parallel file system called GPFS.
-* Your files can be seen on all Niagara login and compute nodes.
-* GPFS is a high-performance file system which provides rapid reads and writes to large data sets in parallel from many nodes.
-* But accessing data sets which consist of many, small files leads to poor performance.
-* Avoid reading and writing lots of small amounts of data to disk.<br />
-<!--T:97-->
-* Many small files on the system would waste space and would be slower to access, read and write.
-* Write data out in binary. Faster and takes less space.
-* The [https://docs.scinet.utoronto.ca/index.php/Burst_Buffer Burst Buffer] is better for i/o heavy jobs and to speed up checkpoints
 = Loading software modules = <!--T:48-->