Bureaucrats, cc_docs_admin, cc_staff
2,306
edits
Béluga/en: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
No edit summary |
||
| Line 56: | Line 56: | ||
A Mellanox Infiniband EDR (100 Gb/s) network connects together all the nodes of the cluster. A central switch of 324 ports links the cluster's island topology with a maximum blocking factor of 5:1. The storage servers are networked with a non-blocking connection. The architecture permits multiple parallel jobs with up to 640 cores (or more) thanks to a non-blocking network. For jobs requiring greater parallelism, the blocking factor is 5:1 but even for jobs executed across several islands, the interconnection is high-performance. | A Mellanox Infiniband EDR (100 Gb/s) network connects together all the nodes of the cluster. A central switch of 324 ports links the cluster's island topology with a maximum blocking factor of 5:1. The storage servers are networked with a non-blocking connection. The architecture permits multiple parallel jobs with up to 640 cores (or more) thanks to a non-blocking network. For jobs requiring greater parallelism, the blocking factor is 5:1 but even for jobs executed across several islands, the interconnection is high-performance. | ||
=Node characteristics= | =Node characteristics= | ||
Turbo mode is activated on all compute nodes of Béluga. | Turbo mode is activated on all compute nodes of Béluga. | ||
| Line 74: | Line 73: | ||
|- | |- | ||
| 172 || 40 || 186G or 191000M ||2 x Intel Gold 6148 Skylake @ 2.4 GHz || 1 x NVMe SSD 1.6T || 4 x NVidia V100SXM2 (16G memory), connected via NVLink | | 172 || 40 || 186G or 191000M ||2 x Intel Gold 6148 Skylake @ 2.4 GHz || 1 x NVMe SSD 1.6T || 4 x NVidia V100SXM2 (16G memory), connected via NVLink | ||
|- | |- | ||
| 1 || 32 || 375G or 384000M || 2 x Intel Gold 6226R Cascade Lake @ 2.9 GHz || 2 x SSD 480G || 8 x NVidia T4 (16G memory) | | 1 || 32 || 375G or 384000M || 2 x Intel Gold 6226R Cascade Lake @ 2.9 GHz || 2 x SSD 480G || 8 x NVidia T4 (16G memory) | ||
|} | |} | ||
* To get a larger <code>$SLURM_TMPDIR</code> space, a job can be submitted with <code>--tmp=xG</code>, where <code>x</code> is a value between 350 and 2490. | * To get a larger <code>$SLURM_TMPDIR</code> space, a job can be submitted with <code>--tmp=xG</code>, where <code>x</code> is a value between 350 and 2490. | ||
* The T4 GPUs are not yet available via Slurm; only CPU cores are usable. | * The T4 GPUs are not yet available via Slurm; only CPU cores are usable. | ||