38,757
edits
No edit summary |
(Updating to match new version of source page) |
||
Line 10: | Line 10: | ||
<div class="mw-translate-fuzzy"> | |||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
Line 20: | Line 21: | ||
| Graham || non ❌ || accès internet désactivé sur les nœuds de calcul | | Graham || non ❌ || accès internet désactivé sur les nœuds de calcul | ||
|} | |} | ||
</div> | |||
=== Béluga === | |||
While it is possible to upload basic metrics to Weights&Biases during a job on Béluga, the wandb package automatically uploads information about the user's environment to a Google Cloud Storage bucket. It is not currently possible to disable this behaviour. Uploading artifacts to W&B with <tt>wandb.save()</tt> also requires access to Google Cloud Storage, which is not available on Béluga's compute nodes. | |||
Users can still use wandb on Béluga by enabling the [https://docs.wandb.ai/library/cli#wandb-offline <tt>offline</tt>] or [https://docs.wandb.ai/library/init#save-logs-offline <tt>dryrun</tt>] modes. In these two modes, wandb will write all metrics, logs and artifacts to the local disk and will not attempt to sync anything to the Weights&Biases service on the internet. After their jobs finish running, users can sync their wandb content to the online service by running the command [https://docs.wandb.ai/ref/cli#wandb-sync <tt>wandb sync</tt>] on the login node. | |||
=== Exemple === | === Exemple === | ||
<div class="mw-translate-fuzzy"> | |||
L'exemple suivant montre comment utiliser wandb pour le suivi de l'expérimentation sur Béluga. Pour reproduire ceci sur Cedar, il n'est pas nécessaire de charger le module <tt>httpproxy</tt>. | L'exemple suivant montre comment utiliser wandb pour le suivi de l'expérimentation sur Béluga. Pour reproduire ceci sur Cedar, il n'est pas nécessaire de charger le module <tt>httpproxy</tt>. | ||
</div> | |||
{{File | {{File | ||
Line 36: | Line 46: | ||
<div class="mw-translate-fuzzy"> | |||
module load python/3.6 httpproxy | module load python/3.6 httpproxy | ||
virtualenv --no-download $SLURM_TMPDIR/env | virtualenv --no-download $SLURM_TMPDIR/env | ||
source $SLURM_TMPDIR/env/bin/activate | source $SLURM_TMPDIR/env/bin/activate | ||
pip install torchvision wandb --no-index | pip install torchvision wandb --no-index | ||
</div> | |||
### Save your wandb API key in your .bash_profile or replace $API_KEY with your actual API key. Uncomment the line below and comment out 'wandb offline'. if running on Cedar ### | |||
# | #wandb login $API_KEY | ||
wandb | wandb offline | ||
python wandb-test.py | python wandb-test.py |