PyTorch: Difference between revisions

PyTorch (view source)

117 bytes removed , 1 month ago

m

no edit summary

cc_staff

282

edits

@@ Line 1,861: / Line 1,861: @@
 <!--T:501-->
-export NCCL_BLOCKING_WAIT=1 #Pytorch Lightning uses the NCCL backend for inter-GPU communication by default. Set this variable to avoid timeout errors.
+export TORCH_NCCL_ASYNC_HANDLING=1
 <!--T:502-->