PyTorch: Difference between revisions

Jump to navigation Jump to search
m
no edit summary
mNo edit summary
mNo edit summary
Line 1,667: Line 1,667:


<!--T:414-->
<!--T:414-->
export NCCL_BLOCKING_WAIT=1 #Pytorch Lightning uses the NCCL backend for inter-GPU communication by default. Set this variable to avoid timeout errors.
export TORCH_NCCL_ASYNC_HANDLING=1


<!--T:415-->
<!--T:415-->
cc_staff
282

edits

Navigation menu