cc_staff
353
edits
AI and Machine Learning: Difference between revisions
Marked this version for translation
(Avoid Anaconda) |
(Marked this version for translation) |
||
| Line 12: | Line 12: | ||
Python is very popular in the field of machine learning. If you (plan to) use it on our clusters, please refer to [[Python|our documentation about Python]] to get important information about Python versions, virtual environments on login or on compute nodes, <tt>multiprocessing</tt>, Anaconda, Jupyter, etc. | Python is very popular in the field of machine learning. If you (plan to) use it on our clusters, please refer to [[Python|our documentation about Python]] to get important information about Python versions, virtual environments on login or on compute nodes, <tt>multiprocessing</tt>, Anaconda, Jupyter, etc. | ||
== Avoid Anaconda == | == Avoid Anaconda == <!--T:21--> | ||
<!--T:22--> | |||
We ask our users to avoid using Anaconda, and use virtualenv instead. Here are the reasons: | We ask our users to avoid using Anaconda, and use virtualenv instead. Here are the reasons: | ||
<!--T:23--> | |||
* Tries to handle library management that should be reserved to staff | * Tries to handle library management that should be reserved to staff | ||
** Ships binaries unoptimized for specific CPU architecture | ** Ships binaries unoptimized for specific CPU architecture | ||
| Line 23: | Line 25: | ||
* Modifies bashrc, which can cause conflicts | * Modifies bashrc, which can cause conflicts | ||
<!--T:24--> | |||
'''Switching to virtualenv is easy in most cases. Just install all the same packages, except CUDA, CuDNN and other low level libraries, which are already installed on our clusters.''' | '''Switching to virtualenv is easy in most cases. Just install all the same packages, except CUDA, CuDNN and other low level libraries, which are already installed on our clusters.''' | ||