Multi-Instance GPU: Difference between revisions

Jump to navigation Jump to search
Reviewed examples
(Reviewed Available configurations)
(Reviewed examples)
Line 42: Line 42:
Note: for the job scheduler on Narval, the prefix <code>a100_</code> is required before the profile name.
Note: for the job scheduler on Narval, the prefix <code>a100_</code> is required before the profile name.


= Examples = <!--T:10-->
== Job examples == <!--T:10-->


<!--T:11-->
<!--T:11-->
Request 1 MIG of power 3/8 and size 20GB for a 1-hour interactive job:
* Request a GPU instance of power 3/8 and size 20GB for a 1-hour interactive job:
</translate>  
</translate>  


<code>salloc --time=1:0:0 --nodes=1 --ntasks-per-node=1 --cpus-per-task=2 --gres=gpu:a100_3g.20gb:1 --mem=20gb --account=def-someuser</code>
{{Command2
|salloc --account{{=}}def-someuser --gres{{=}}gpu:a100_3g.20gb:1 --cpus-per-task{{=}}2 --mem{{=}}40gb --time{{=}}1:0:0
}}


<translate>  
<translate>  
<!--T:12-->
<!--T:12-->
Request 1 MIG of power 4/8 and size 20GB for a 24-hour batch script using the maximum recommended number of cores and system memory.
* Request a GPU instance of power 4/8 and size 20GB for a 24-hour batch job using the maximum recommended number of cores and system memory:
</translate>  
</translate>  


Line 60: Line 62:
   |contents=
   |contents=
#!/bin/bash
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --account=def-someuser
#SBATCH --gres=gpu:a100_4g.20gb:1  
#SBATCH --gres=gpu:a100_4g.20gb:1  
#SBATCH --ntasks=1
#SBATCH --cpus-per-task=6    # There are 6 CPU cores per 3g.20gb and 4g.20gb on Narval.
#SBATCH --cpus-per-task=6    # There are 6 CPU cores per 3g.20gb and 4g.20gb on Narval.
#SBATCH --mem=40gb           # Request double the system memory than MIG memory
#SBATCH --mem=62gb           # There are 62GB GPU RAM per 3g.20gb and 4g.20gb on Narval.
#SBATCH --time=24:00:00
#SBATCH --time=24:00:00
#SBATCH --account=def-someuser
 
hostname
hostname
nvidia-smi
nvidia-smi
}}
}}


<translate>  
<translate>
 
= Finding which of your jobs to migrate to using a MIG = <!--T:13-->
= Finding which of your jobs to migrate to using a MIG = <!--T:13-->


cc_staff
782

edits

Navigation menu