cc_staff
353
edits
AI and Machine Learning: Difference between revisions
Jump to navigation
Jump to search
Add troubleshooting section
(Marked this version for translation) |
(Add troubleshooting section) |
||
| Line 96: | Line 96: | ||
<!--T:30--> | <!--T:30--> | ||
Note that Comet is not currently available on Graham. | Note that Comet is not currently available on Graham. | ||
== Troubleshooting == | |||
=== Determinism with RNN using CUDA === | |||
RNN and multi-head attention API calls may exhibit non-deterministic behavior when the cuDNN library is built with CUDA Toolkit 10.2 or higher. The user can eliminate the non-deterministic behavior of cuDNN RNN and multi-head attention APIs by setting a single buffer size in the CUBLAS_WORKSPACE_CONFIG environmental variable, for example, :16:8 or :4096:2, which instructs cuBLAS to allocate eight buffers of 16 KB each in GPU memory or two buffers of 4 MB each. | |||
</translate> | </translate> | ||