NCCL: Difference between revisions
Jump to navigation
Jump to search
(NCCL page) |
No edit summary |
||
| Line 9: | Line 9: | ||
To fix <code>Caught error during NCCL init [...] connect() timed out</code> errors, set the following variable before running NCCL: | To fix <code>Caught error during NCCL init [...] connect() timed out</code> errors, set the following variable before running NCCL: | ||
NCCL_BLOCKING_WAIT=1 | export NCCL_BLOCKING_WAIT=1 | ||
Latest revision as of 15:09, 18 November 2020
This article is a draft
This is not a complete article: This is a draft, a work in progress that is intended to be published into an article, which may or may not be ready for inclusion in the main wiki. It should not necessarily be considered factual or authoritative.
What is NCCL
Please see the NVIDIA webpage.
Troubleshooting
To activate NCCL debug outputs, set the following variable before running NCCL:
NCCL_DEBUG=info
To fix Caught error during NCCL init [...] connect() timed out errors, set the following variable before running NCCL:
export NCCL_BLOCKING_WAIT=1