cc_staff
2
edits
Niagara: Difference between revisions
Jump to navigation
Jump to search
m
niagara has five dragonfly wings, not four
No edit summary |
m (niagara has five dragonfly wings, not four) |
||
| Line 44: | Line 44: | ||
* 2024 nodes, each with 40 Intel "Skylake" cores at 2.4 GHz or 40 Intel "CascadeLake" cores at 2.5 GHz, for a total of 80,640 cores. | * 2024 nodes, each with 40 Intel "Skylake" cores at 2.4 GHz or 40 Intel "CascadeLake" cores at 2.5 GHz, for a total of 80,640 cores. | ||
* 202 GB (188 GiB) of RAM per node. | * 202 GB (188 GiB) of RAM per node. | ||
* EDR Infiniband network in a | * EDR Infiniband network in a 'Dragonfly+' topology. | ||
* 12.5PB of scratch, 3.5PB of project space (parallel filesystem: IBM Spectrum Scale, formerly known as GPFS). | * 12.5PB of scratch, 3.5PB of project space (parallel filesystem: IBM Spectrum Scale, formerly known as GPFS). | ||
* 256 TB burst buffer (Excelero + IBM Spectrum Scale). | * 256 TB burst buffer (Excelero + IBM Spectrum Scale). | ||
| Line 80: | Line 80: | ||
<!--T:11--> | <!--T:11--> | ||
The Niagara cluster has an EDR Infiniband network in a | The Niagara cluster has an EDR Infiniband network in a 'Dragonfly+' topology, with five wings. | ||
'Dragonfly+' topology, with | Each wing of maximually 432 nodes (i.e., 17280 cores) has | ||
1-to-1 connections. Network traffic between wings is done through | 1-to-1 connections. Network traffic between wings is done through | ||
adaptive routing, which alleviates network congestion and yields an effective blocking of 2:1 between nodes of different wings. | adaptive routing, which alleviates network congestion and yields an effective blocking of 2:1 between nodes of different wings. | ||