National systems: Difference between revisions

From Alliance Doc
Jump to navigation Jump to search
mNo edit summary
No edit summary
 
(38 intermediate revisions by 10 users not shown)
Line 1: Line 1:
<languages />
<languages />
<translate>
<translate>


==CCDB Descriptions== <!--T:9-->
==Compute clusters== <!--T:1-->


<!--T:10-->
<!--T:3-->
General descriptions are also available on CCDB:
A ''general-purpose'' cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes.  We broadly classify the nodes as:
* [https://ccdb.computecanada.ca/resources/Graham-Compute Cedar-Compute]
* ''base'' nodes, containing typically about 4GB of memory per core;
* [https://ccdb.computecanada.ca/resources/Cedar-GPU Cedar-GPU]
* ''large-memory'' nodes, containing typically more than 8GB memory per core;
* [https://ccdb.computecanada.ca/resources/Graham-Compute Graham-Compute]
* ''GPU'' nodes, which contain [https://en.wikipedia.org/wiki/Graphics_processing_unit graphic processing units].
* [https://ccdb.computecanada.ca/resources/Graham-GPU Graham-GPU]
* [https://ccdb.computecanada.ca/resources/NDC-SFU NDC-SFU]
* [https://ccdb.computecanada.ca/resources/NDC-Waterloo NDC-Waterloo]


==Compute== <!--T:1-->
<!--T:17-->
The ''large parallel'' cluster [[Niagara]] is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there.  Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.


===Overview=== <!--T:2-->
<!--T:18-->
All clusters have large, high-performance storage attached.  For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.


<!--T:3-->
===List of compute clusters=== <!--T:14-->
Cedar(GP2) and Graham(GP3) are almost identical systems with some minor differences in the actual mix of large memory, small memory and GPU nodes.


<!--T:4-->
<!--T:15-->
{| class="wikitable"
{| class="wikitable"
|-
|-
! Name !! Description !! Capacity !! Status
! Name and link !! Type !! Sub-systems !! Status
|-
|-
| [[CC-Cloud Resources]]
| [[Béluga/en|Béluga]]
Arbutus/west.cloud (GP1)<br />
| General-purpose
east.cloud
|
|| OpenStack IAAS Cloud || 7,640 cores || In production<br /> (integrated with west.cloud)
* beluga-compute
* beluga-gpu
* beluga-storage
| In production
|-
|-
| [[GP2|Cedar(GP2)]] ||
| [[Cedar|Cedar]]
heterogeneous, general-purpose cluster
| General-purpose
* Serial and small parallel jobs
|
* GPU and big memory nodes
* cedar-compute
* Small cloud partition
* cedar-gpu
|| 27,696 cores || In production
* cedar-storage
| In production
|-
|-
| [[GP3|Graham(GP3)]] ||
| [[Graham|Graham]]
heterogeneous, general-purpose cluster
| General-purpose
* Serial and small parallel jobs
|
* GPU and big memory nodes
* graham-compute
* Small cloud partition
* graham-gpu
|| 33,376 cores || In production
* graham-storage
| In production
|-
|-
| [[GP4|GP4]] ||
| [[Narval/en|Narval]]
heterogeneous, general-purpose cluster
| General-purpose
* May have GPU's, large mem, etc.
|
|| Approx 40,000 cores || RFP closes in May, 2018
* narval-compute
* narval-gpu
* narval-storage
| In production
|-
|-
| [[LP|Niagara(LP)]] ||
| [[Niagara|Niagara]]
homogeneous, large parallel cluster
| Large parallel
* Designed for large parallel jobs > 1000 cores
|
|| ~60,000 cores || Vendor negotiations
* niagara-compute
* niagara-storage
* hpss-storage
| In production
|}
|}


<!--T:5-->
==Cloud - Infrastructure as a Service== <!--T:16-->
Note that GP1, GP2, GP3, GP4 and LP will all have large, high-performance attached storage.
Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.


<!--T:6-->
<!--T:4-->
{{:Cedar}}
{| class="wikitable"
 
|-
<!--T:7-->
! Name and link !! Sub-systems !! Description !! Status
{{:Graham}}
|-
 
| [[Cloud_resources#Arbutus_cloud|Arbutus cloud]]
<!--T:8-->
|
{{:National_Data_Cyberinfrastructure}}
* arbutus-compute-cloud
* arbutus-persistent-cloud
* arbutus-dcache
|
* VCPU, VGPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Shared filesystem storage (backed up)
* Object storage
* Floating IPs
* dCache storage
| In production
|-
| [[Cloud_resources#B.C3.A9luga_cloud|Béluga cloud]]
|
* beluga-compute-cloud
* beluga-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|-
| [[Cloud_resources#Cedar_cloud|Cedar cloud]]
|
* cedar-persistent-cloud
* cedar-compute-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|-
| [[Cloud_resources#Graham_cloud|Graham cloud]]
|
* graham-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
|}


</translate>
</translate>
[[Category:Migration2016]]

Latest revision as of 14:23, 8 April 2022

Other languages:

Compute clusters

A general-purpose cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes. We broadly classify the nodes as:

  • base nodes, containing typically about 4GB of memory per core;
  • large-memory nodes, containing typically more than 8GB memory per core;
  • GPU nodes, which contain graphic processing units.

The large parallel cluster Niagara is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there. Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.

All clusters have large, high-performance storage attached. For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.

List of compute clusters

Name and link Type Sub-systems Status
Béluga General-purpose
  • beluga-compute
  • beluga-gpu
  • beluga-storage
 In production
Cedar General-purpose
  • cedar-compute
  • cedar-gpu
  • cedar-storage
 In production
Graham General-purpose
  • graham-compute
  • graham-gpu
  • graham-storage
 In production
Narval General-purpose
  • narval-compute
  • narval-gpu
  • narval-storage
 In production
Niagara Large parallel
  • niagara-compute
  • niagara-storage
  • hpss-storage
 In production

Cloud - Infrastructure as a Service

Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.

Name and link Sub-systems Description Status
Arbutus cloud
  • arbutus-compute-cloud
  • arbutus-persistent-cloud
  • arbutus-dcache
  • VCPU, VGPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Shared filesystem storage (backed up)
  • Object storage
  • Floating IPs
  • dCache storage
 In production
Béluga cloud
  • beluga-compute-cloud
  • beluga-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Cedar cloud
  • cedar-persistent-cloud
  • cedar-compute-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Graham cloud
  • graham-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
 In production
Retrieved from "https://docs.alliancecan.ca/mediawiki/index.php?title=National_systems&oldid=113660"