Multi-Instance GPU: Difference between revisions

Power consumption is a good indicator of the total computing power requested from the GPU. For instance, the following job requested one A100 GPU with a maximum TDP of 400W, but only used 100W on average, which is only 50W more than the idle electric consumption:

[[File:ExampleGPUPower.png|400px|frame|left|Example GPU Power usage of a job on a A100 GPU]]  

GPU functionality utilization may also provide insights on the usage of the GPU in cases where the Electric power consumption is not sufficient. For this example job, GPU utilization graph supports the conclusion of the GPU power consumption graph that the job use less than 25% of the available power of a full A100 GPU:

[[File:ExampleGPUUtilisation.png|400px|frame|left|Example GPU Utilization of a job on a A100 GPU]]

The final things to consider is the maximum amount of GPU memory and average number of CPU cores required to run the job. For this example, the job uses a maximum of 3GB of GPU memory out of the 40GB of an A100 GPU.  

[[File:ExampleGPUMemory.png|400px|frame|left|Example GPU memory usage of a job on a A100 GPU]]