38,760
edits
Cedar/en: Difference between revisions
Jump to navigation
Jump to search
Updating to match new version of source page
(Updating to match new version of source page) |
(Updating to match new version of source page) |
||
| Line 35: | Line 35: | ||
* Not allocated. | * Not allocated. | ||
* Large fixed [[Storage and file management#Filesystem_Quotas_and_Policies|quota]] per user. | * Large fixed [[Storage and file management#Filesystem_Quotas_and_Policies|quota]] per user. | ||
* Inactive data will be purged. | * Inactive data will be [[Scratch purging policy|purged]]. | ||
|- | |- | ||
|'''Project space'''<br />10PB total volume<br />External persistent storage | |'''Project space'''<br />10PB total volume<br />External persistent storage | ||
| Line 55: | Line 55: | ||
=Node types and characteristics= | =Node types and characteristics= | ||
Cedar has a total of | Cedar has a total of 58,416 CPU cores for computation, and 584 GPU devices. Total theoretical peak double precision performance is 936 teraflops for CPUs, plus 2,744 for GPUs, yielding over 3.6 petaflops of theoretical peak double precision performance. 22 fully connected "islands" of 32 base or large nodes each have 1024 cores in a fully non-blocking topology (Omni-Path fabric), with each island designed to yield over 30 teraflops of double-precision performance (measured with high performance LINPACK). There is a 2:1 blocking factor between the 1024 core islands. | ||
{| class="wikitable sortable" | {| class="wikitable sortable" | ||
|- | |- | ||
| base nodes || 576 nodes || 128 | | base nodes || 576 nodes || 128 GiB of memory (125 GiB usable), 16 cores/socket, 2 sockets/node. Intel "Broadwell" CPUs at 2.1Ghz, model E5-2683 v4. | ||
|- | |- | ||
| large nodes || 128 nodes || 256 | | large nodes || 128 nodes || 256 GiB of memory (251 Gib usable), 16 cores/socket, 2 sockets/node. Intel "Broadwell" CPUs at 2.1Ghz, model E5-2683 v4. | ||
|- | |- | ||
| GPU base nodes || 114 nodes || 128 | | GPU base nodes || 114 nodes || 128 GiB of memory (125 GiB usable), 12 cores/socket, 2 sockets/node, 4 NVIDIA P100 Pascal GPUs/node (12GB HBM2 memory), 2 GPUs/PCI root. Intel "Broadwell" CPUs at 2.2Ghz, model E5-2650 v4 | ||
|- | |- | ||
| GPU large nodes || 32 nodes || 256 | | GPU large nodes || 32 nodes || 256 GiB of memory (251 Gib usable), 12 cores/socket, 2 sockets/node, 4 NVIDIA P100 Pascal GPUs/node (16GB HBM2 memory), All GPUs on the same PCI root. E5-2650 v4 | ||
|- | |- | ||
| bigmem500 nodes || 24 nodes || | | bigmem500 nodes || 24 nodes || 512 GiB of memory (503 GiB usable), 16 cores/socket, 2 sockets/node. Intel "Broadwell" CPUs at 2.1Ghz, model E5-2683 v4. | ||
|- | |- | ||
|bigmem1500 nodes || 24 nodes || 1.5 | |bigmem1500 nodes || 24 nodes || 1.5 TiB of memory (1511 GiB usable), 16 cores/socket, 2 sockets/node. Intel "Broadwell" CPUs at 2.1Ghz, model E5-2683 v4. | ||
|- | |- | ||
| bigmem3000 nodes || 4 nodes || 3 | | bigmem3000 nodes || 4 nodes || 3 TiB of memory (3023 GiB usable), 8 cores/socket, 4 sockets/node. Intel "Broadwell" CPUs at 2.1Ghz, model E7-4809 v4. | ||
|- | |||
| Skylake base nodes || 640 nodes || 192 GiB of memory (187 GiB usable), 24 cores/socket, 2 sockets/node. Intel "Skylake" CPUs at 2.1Ghz, model Platinum 8160F. | |||
|} | |} | ||