Niagara Quickstart: Difference between revisions

no edit summary
No edit summary
No edit summary
Line 323: Line 323:


== Scheduling by node == <!--T:79-->
== Scheduling by node == <!--T:79-->
On many systems that use SLURM, the scheduler will deduce from the specifications of the number of tasks and the number of cpus-per-node what resources should be allocated.  On Niagara things are a bit different.


<!--T:80-->
<!--T:80-->
<ul>
<ul>
<li><p>All job resource requests on Niagara are scheduled as a multiple of '''nodes'''.</p></li>
<li><p>All job resource requests on Niagara are scheduled as a multiple of '''nodes'''.</p></li>
<li>The nodes that your jobs run on are exclusively yours.
<li>The nodes that your jobs run on are exclusively yours, for as long as the job is running on them.
<ul>
<ul>
<li>No other users are running anything on them.</li>
<li>No other users are running anything on them.</li>
Line 333: Line 334:
</li>
</li>
<li><p>Whatever your requests to the scheduler, it will always be translated into a multiple of nodes allocated to your job.</p></li>
<li><p>Whatever your requests to the scheduler, it will always be translated into a multiple of nodes allocated to your job.</p></li>
<li><p>Memory requests to the scheduler are of no use. Your job always gets N x 202GB of RAM, where N is the number of nodes.</p></li>
<li><p>Memory requests to the scheduler are of no use. Your job always gets N x 202GB of RAM, where N is the number of nodes and 202GB is the amount of memory on the node.</p></li>
<li><p>You should try to use all the cores on the nodes allocated to your job. Since there are 40 cores per node, your job should use N x 40 cores. If this is not the case, we will be contacted you to help you optimize your workflow.</p></li></ul>
<li><p>If you run serial jobs you must still use all 40 cores on the node.  Visit the [[Running_Serial_Jobs_on_Niagara | serial jobs]] page for examples of how to do this.</p></li>
<li><p>Since there are 40 cores per node, your job should use N x 40 cores. If you do not, we will contact you to help you optimize your workflow.  Or you can [mailto:support@scinet.utoronto.ca contact us] to get assistance.</p></li></ul>


== Hyperthreading: Logical CPUs vs. cores == <!--T:81-->
== Hyperthreading: Logical CPUs vs. cores == <!--T:81-->
cc_staff
290

edits