AI and Machine Learning: Difference between revisions

no edit summary
mNo edit summary
No edit summary
Line 3: Line 3:
<translate>
<translate>
<!--T:1-->
<!--T:1-->
To get the most out of our clusters for machine learning applications, special care must be taken. A cluster is a complicated beast that is very different from your local machine that you use for prototyping. Notably, a cluster uses a distributed filesystem, linking many storage devices seamlessly. Accessing a file on <tt>/project</tt> ''feels the same'' as accessing one from the current node; but under the hood, these two IO operations have very different performance implications. In short, you need to [[#Managing_your_datasets|choose wisely where to put your data]].
To get the most out of our clusters for machine learning applications, special care must be taken. A cluster is a complicated beast that is very different from your local machine that you use for prototyping. Notably, a cluster uses a distributed filesystem, linking many storage devices seamlessly. Accessing a file on <tt>/project</tt> may <i>feel the same</i> as accessing one from the current node, but under the hood, these two IO operations have very different performance implications. In short, you need to [[#Managing_your_datasets|choose wisely where to put your data]].


<!--T:2-->
<!--T:2-->
Line 11: Line 11:


<!--T:26-->
<!--T:26-->
If you are ready to port your program for using on a Alliance cluster, please follow [[Tutoriel_Apprentissage_machine/en|our tutorial]].
If you are ready to port your program for using on one of our clusters, please follow [[Tutoriel_Apprentissage_machine/en|our tutorial]].


<!--T:36-->
<!--T:36-->
rsnt_translations
56,420

edits