National systems: Difference between revisions

From Alliance Doc
Jump to navigation Jump to search
No edit summary
 
(145 intermediate revisions by 11 users not shown)
Line 1: Line 1:
<table border="5" style="border-color:red;width:100%">
<languages />
<tr><td>Sharing: Public</td><td align="center" style="font-size:18px">'''Early Draft'''</td><td align="right">Author:CC Migration team</td></tr>
<translate>
</table>


==Introduction==
==Compute clusters== <!--T:1-->


TBD - detailed docs for the new systems are being written by the Research Support National Team.
<!--T:3-->
A ''general-purpose'' cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes.  We broadly classify the nodes as:
* ''base'' nodes, containing typically about 4GB of memory per core;
* ''large-memory'' nodes, containing typically more than 8GB memory per core;
* ''GPU'' nodes, which contain [https://en.wikipedia.org/wiki/Graphics_processing_unit graphic processing units].


==Compute==
<!--T:17-->
The ''large parallel'' cluster [[Niagara]] is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there.  Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.


<table border="1">
<!--T:18-->
<tr style="background:lightblue;font-weight:bold"><td>Name</td><td>Description</td><td align="center">Approximate Capacity</td><td>Availability</td></tr>
All clusters have large, high-performance storage attached.  For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.
<tr><td>[[CC-Cloud Resources]] (GP1)</td><td>cloud</td><td align="center">7,640 cores</td><td>In production (integrated with west.cloud)</td></tr>
<tr><td>[[GP2]]</td><td>general-purpose cluster (serial and small parallel jobs)</td><td align="center">25,000 cores</td><td>February, 2017</td></tr>
<tr><td>[[GP3]]</td><td>general-purpose cluster (serial and small parallel jobs)</td><td align="center">25,000 cores</td><td>May, 2017</td></tr>
<tr><td>[[LP]]</td><td>a cluster designed for large parallel jobs</td><td  align="center">60,000 cores</td><td>Summer, 2017</tr>
<tr><td>[[Available software]]</td></tr>
</table>


==National Data Cyberinfrastructure==
===List of compute clusters=== <!--T:14-->


===Storage Components===
<!--T:15-->
{| class="wikitable"
|-
! Name and link !! Type !! Sub-systems !! Status
|-
| [[Béluga/en|Béluga]]
| General-purpose
|
* beluga-compute
* beluga-gpu
* beluga-storage
| In production
|-
| [[Cedar|Cedar]]
| General-purpose
|
* cedar-compute
* cedar-gpu
* cedar-storage
| In production
|-
| [[Graham|Graham]]
| General-purpose
|
* graham-compute
* graham-gpu
* graham-storage
| In production
|-
| [[Narval/en|Narval]]
| General-purpose
|
* narval-compute
* narval-gpu
* narval-storage
| In production
|-
| [[Niagara|Niagara]]
| Large parallel
|
* niagara-compute
* niagara-storage
* hpss-storage
| In production
|}


The National Data cyberinfrastructure will have 2 components:
==Cloud - Infrastructure as a Service== <!--T:16-->
Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.


<table border="1">
<!--T:4-->
<tr><td>1</td><td>Object Storage</td>
{| class="wikitable"
<td>
|-
A fully distributed object storage system spanning all 4 sites, with geo-redundancy, replication and universal access.
! Name and link !! Sub-systems !! Description !! Status
</td>
|-
</tr>
| [[Cloud_resources#Arbutus_cloud|Arbutus cloud]]
<tr><td>2</td><td>Long-term or Nearline File Storage</td>
|
<td>
* arbutus-compute-cloud
"Nearline"<br />Long-term file storage sites (similar to Silo) at SFU and the University of Waterloo. Each site will have tape backup.
* arbutus-persistent-cloud
</td>
* arbutus-dcache
</tr>
|
</table>
* VCPU, VGPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Shared filesystem storage (backed up)
* Object storage
* Floating IPs
* dCache storage
| In production
|-
| [[Cloud_resources#B.C3.A9luga_cloud|Béluga cloud]]
|
* beluga-compute-cloud
* beluga-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|-
| [[Cloud_resources#Cedar_cloud|Cedar cloud]]
|
* cedar-persistent-cloud
* cedar-compute-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|-
| [[Cloud_resources#Graham_cloud|Graham cloud]]
|
* graham-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|}


===Capacity and Availability===
</translate>
 
<table border="1">
<tr style="background:lightblue;font-weight:bold"><td>Type</td><td>Location</td><td>Capacity</td><td>Availability</td><td>Comments</td></tr>
<tr>
<td>'''Long-term File Storage'''</td>
<td>
Sites at SFU and Waterloo
</td>
<td>15 PB each</td>
<td>Interim: Early November (Delayed)</td>
<td>
* Tape backup
* '''Silo replacement'''
* Aiming for redundant tape backup across sites
</td>
</tr><tr>
<td>'''Object Store'''</td>
<td>All 4 sites</td>
<td>
Small to start (A few PB usable)
</td>
<td>Late 2016</td>
<td>
* Fully distributed, redundant object storage
* Accessible anywhere
* Allows for redundant, high availability architectures
* S3 and File interfaces
* New service aimed at experimental and observational data
</td>
</tr><tr>
<td>'''Special Purpose'''</td>
<td>All 4 sites</td>
<td>~3.5 PB</td>
<td>Specialized migration plans</td>
<td>
* Special purpose for Atlas, LHC, SNO+, CANFAR
* dCache and other customized configurations
</td>
</tr>
</table>
 
* [[User:Pjmann|Patrick Mann]] ([[User talk:Pjmann|talk]]) 16:43, 20 October 2016 (UTC) Storage Building Blocks have been delivered and are being installed.
* [[User:Pjmann|Patrick Mann]] ([[User talk:Pjmann|talk]]) 15:26, 23 September 2016 (UTC) Note that due to Silo decommissioning Dec.31/2016 it will be necessary to provide interim storage while the NSI is developed. See [[Migration2016:Silo]] for details.
 
[[Category:Migration2016]]

Latest revision as of 14:23, 8 April 2022

Other languages:

Compute clusters

A general-purpose cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes. We broadly classify the nodes as:

  • base nodes, containing typically about 4GB of memory per core;
  • large-memory nodes, containing typically more than 8GB memory per core;
  • GPU nodes, which contain graphic processing units.

The large parallel cluster Niagara is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there. Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.

All clusters have large, high-performance storage attached. For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.

List of compute clusters

Name and link Type Sub-systems Status
Béluga General-purpose
  • beluga-compute
  • beluga-gpu
  • beluga-storage
 In production
Cedar General-purpose
  • cedar-compute
  • cedar-gpu
  • cedar-storage
 In production
Graham General-purpose
  • graham-compute
  • graham-gpu
  • graham-storage
 In production
Narval General-purpose
  • narval-compute
  • narval-gpu
  • narval-storage
 In production
Niagara Large parallel
  • niagara-compute
  • niagara-storage
  • hpss-storage
 In production

Cloud - Infrastructure as a Service

Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.

Name and link Sub-systems Description Status
Arbutus cloud
  • arbutus-compute-cloud
  • arbutus-persistent-cloud
  • arbutus-dcache
  • VCPU, VGPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Shared filesystem storage (backed up)
  • Object storage
  • Floating IPs
  • dCache storage
 In production
Béluga cloud
  • beluga-compute-cloud
  • beluga-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Cedar cloud
  • cedar-persistent-cloud
  • cedar-compute-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Graham cloud
  • graham-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Retrieved from "https://docs.alliancecan.ca/mediawiki/index.php?title=National_systems&oldid=113660"