Graham: Difference between revisions
No edit summary |
No edit summary |
||
| Line 8: | Line 8: | ||
<!--T:2--> | <!--T:2--> | ||
GRAHAM is a heterogeneous cluster, suitable for a variety of workloads, and located at the University of Waterloo. It is named after [https://en.wikipedia.org/wiki/Wes_Graham Wes Graham], the first director of the Computing Centre at Waterloo. It was previously known as "GP3" and is still identified as such in the [https://www.computecanada.ca/research-portal/accessing-resources/resource-allocation-competitions/ 2017 RAC] documentation. | GRAHAM is a heterogeneous cluster, suitable for a variety of workloads, and located at the University of Waterloo. It is named after [https://en.wikipedia.org/wiki/Wes_Graham Wes Graham], the first director of the Computing Centre at Waterloo. It was previously known as "GP3" and is still identified as such in the [https://www.computecanada.ca/research-portal/accessing-resources/resource-allocation-competitions/ 2017 RAC] documentation. | ||
<!--T:4--> | <!--T:4--> | ||
The parallel filesystem, interconnects and external persistent storage ([[National Data Cyberinfrastructure|NDC-Waterloo]]) will be the | The parallel filesystem, interconnects and external persistent storage ([[National Data Cyberinfrastructure|NDC-Waterloo]]) will be the similar to [[Cedar|Cedar's]]. There is a slightly different mix of compute nodes and interconnect type. | ||
====Attached Storage System==== <!--T:4--> | ====Attached Storage System==== <!--T:4--> | ||
Revision as of 17:54, 12 January 2017
Graham (GP3)
GRAHAM is a heterogeneous cluster, suitable for a variety of workloads, and located at the University of Waterloo. It is named after Wes Graham, the first director of the Computing Centre at Waterloo. It was previously known as "GP3" and is still identified as such in the 2017 RAC documentation.
The parallel filesystem, interconnects and external persistent storage (NDC-Waterloo) will be the similar to Cedar's. There is a slightly different mix of compute nodes and interconnect type.
Attached Storage System
| $HOME |
Standard home directory |
| $SCRATCH Parallel High-performance filesystem |
Approximately 3PB usable capacity for temporary ( |
| $PROJECT External persistent storage |
Provided by the NDC. |
High Performance Interconnect
A low-latency high-performance fabric connecting all nodes and temporary storage.
The design of Graham is to support multiple simultaneous parallel jobs of up to 1024 cores in a fully non-blocking manner.
Node types and characteristics
| "Base" compute nodes | 800 nodes | 16 cores/socket, 2 sockets/node, 128 GB of memory. |
| "Bigmem512" nodes | 24 nodes | 16 cores/socket, 2 sockets/node, 512 GB of memory. |
| "Bigmem3000" nodes | 3 nodes | 16 cores/socket, 4 sockets/node, 3 TB of memory. |
| "GPU" nodes | 160 nodes | 16 cores/socket, 2 sockets/node, 128 GB of memory, 2 NVIDIA P100 GPUs. |
| "Large" nodes | 56 nodes | 16 cores/socket, 2 sockets/node, 256 GB of memory. |
All of the above nodes will have approximately 1TB of local (on-node) storage provided by SSD drives available in /tmp.
The delivery and installation schedule is not yet confirmed.