rsnt_translations
56,430
edits
RAPIDS: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
No edit summary |
||
| Line 13: | Line 13: | ||
This page provides the instructions for working with RAPIDS on Compute Canada clusters based from a Singularity container. | This page provides the instructions for working with RAPIDS on Compute Canada clusters based from a Singularity container. | ||
=Building a Singularity image | =Building a Singularity image= <!--T:5--> | ||
To build a Singularity image for RAPIDS the first thing to do is to find and select a Docker image | To build a Singularity image for RAPIDS, the first thing to do is to find and select a Docker image provided by NVIDIA. | ||
==Finding a Docker image | ==Finding a Docker image== <!--T:6--> | ||
There are three types of RAPIDS Docker images: ''base'', ''runtime'', and ''devel''. For each type, multiple images are provided for different combinations of RAPIDS and CUDA versions, either on Ubuntu or on CentOS. You can find the Docker <tt>pull</tt> command for a selected image under the '''Tags''' tab on each site. | There are three types of RAPIDS Docker images: ''base'', ''runtime'', and ''devel''. For each type, multiple images are provided for different combinations of RAPIDS and CUDA versions, either on Ubuntu or on CentOS. You can find the Docker <tt>pull</tt> command for a selected image under the '''Tags''' tab on each site. | ||
| Line 23: | Line 23: | ||
<!--T:7--> | <!--T:7--> | ||
* [https://ngc.nvidia.com/catalog/containers/nvidia:rapidsai:rapidsai NVIDIA GPU Cloud (NGC)] | * [https://ngc.nvidia.com/catalog/containers/nvidia:rapidsai:rapidsai NVIDIA GPU Cloud (NGC)] | ||
** '''base''' images contain a RAPIDS environment ready | ** '''base''' images contain a RAPIDS environment ready for use. Use this type of image if you want to submit a job to the Slurm scheduler. | ||
** '''runtime''' images extend the base image by adding a Jupyter notebook server and example notebooks. Use this type of image if you want to interactively work with RAPIDS through notebooks and examples. | ** '''runtime''' images extend the base image by adding a Jupyter notebook server and example notebooks. Use this type of image if you want to interactively work with RAPIDS through notebooks and examples. | ||
* [https://hub.docker.com/r/rapidsai/rapidsai-dev Docker Hub] | * [https://hub.docker.com/r/rapidsai/rapidsai-dev Docker Hub] | ||
| Line 44: | Line 44: | ||
=Working on clusters with a Singularity image= <!--T:12--> | =Working on clusters with a Singularity image= <!--T:12--> | ||
Once you have a Singularity image for RAPIDS ready in your account, you can | Once you have a Singularity image for RAPIDS ready in your account, you can request an interactive session on a GPU node or submit a batch job to the Slurm queue if you have your RAPIDS code ready. | ||
==Exploring the contents in RAPIDS== | ==Exploring the contents in RAPIDS== | ||
<!--T:13--> | <!--T:13--> | ||
To explore the contents without doing any computations, you can use the following commands to access the container shell of the Singularity image (here''rapids.sif'') on any node without requesting a GPU. | To explore the contents without doing any computations, you can use the following commands to access the container shell of the Singularity image (here ''rapids.sif'') on any node without requesting a GPU. | ||