Using GPUs with Slurm: Difference between revisions

<translate>

To request one or more GPUs for a Slurm job, use this form:

   --gpus-per-node=[type:]number

The square-bracket notation means that you must specify the number of GPUs, and you may optionally specify the GPU type.  Choose a type from the "Available hardware" table below.  Here are two examples:

   --gpus-per-node=2

   --gpus-per-node=v100:1

The first example requests two GPUs per node, of any type available on the cluster.  The second example requests one GPU per node, with the GPU being of the V100 type.

The following form can also be used:

   --gres=gpu[[:type]:number]

This is older, and we expect it will no longer be supported in some future release of Slurm.  We recommend that you replace it in your scripts with the above --gpus-per-node form.

There are a variety of other directives that you can use to request GPUs and related resources: --gpus, --gpus-per-socket, --gpus-per-task, --mem-per-gpu, and --ntasks-per-gpu.  Please see the Slurm documentation for [https://slurm.schedmd.com/sbatch.html sbatch] for more about these.  Alliance staff have not tested many combinations of these, so if you try them and don't get the resources you expect or want, [[Technical support|contact support]].

In such a case, make sure you include a type specifier.

== Single-core job == <!--T:3-->

}}

For each GPU requested on:

* Béluga, we recommend no more than 10 CPU cores.