National systems: Difference between revisions

From Alliance Doc
Jump to navigation Jump to search
(Updated links to CCDB resource pages)
No edit summary
 
(11 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{Outdated}}
<languages />
<languages />
<translate>
<translate>
Line 7: Line 5:


<!--T:3-->
<!--T:3-->
All ''general-purpose'' systems are similar with some differences in interconnect and the number of small memory, large memory and GPU nodes. Niagara is a different system and is designed for ''large parallel'' jobs.
A ''general-purpose'' cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes.  We broadly classify the nodes as:
* ''base'' nodes, containing typically about 4GB of memory per core;
* ''large-memory'' nodes, containing typically more than 8GB memory per core;
* ''GPU'' nodes, which contain [https://en.wikipedia.org/wiki/Graphics_processing_unit graphic processing units].


<!--T:5-->
<!--T:17-->
All systems have large, high-performance attached storage; see the relevant cluster page for more details.
The ''large parallel'' cluster [[Niagara]] is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there.  Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.


===Types of compute clusters===
<!--T:18-->
All clusters have large, high-performance storage attached.  For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.


{| class="wikitable"
===List of compute clusters=== <!--T:14-->
|-
! Type !! Type of nodes !! Type of jobs
|-
| General-purpose
|
* Small memory nodes
* Regular nodes (4GB/core)
* Large memory nodes
* GPU nodes
|
* Serial and small parallel jobs
* Small or large memory jobs
* GPU jobs
|-
| Large parallel
|
* Uniform nodes (4GB/core)
* Optimized interconnect
|
* Parallel jobs requiring +1000 cores
|}
 
===List of compute clusters===


<!--T:15-->
{| class="wikitable"
{| class="wikitable"
|-
|-
! Name and link !! Type !! CCDB Descriptions !! Status
! Name and link !! Type !! Sub-systems !! Status
|-
|-
| [[Béluga/en|Béluga]]
| [[Béluga/en|Béluga]]
| General-purpose
| General-purpose
|
|
* [https://ccdb.computecanada.ca/resources/beluga-compute Béluga-Compute]
* beluga-compute
* [https://ccdb.computecanada.ca/resources/beluga-gpu Béluga-GPU]
* beluga-gpu
* [https://ccdb.computecanada.ca/resources/beluga-storage Béluga-Storage]
* beluga-storage
| In production
| In production
|-
|-
Line 54: Line 34:
| General-purpose
| General-purpose
|
|
* [https://ccdb.computecanada.ca/resources/cedar-compute Cedar-Compute]
* cedar-compute
* [https://ccdb.computecanada.ca/resources/cedar-gpu Cedar-GPU]
* cedar-gpu
* [https://ccdb.computecanada.ca/resources/cedar-storage Cedar-Storage]
* cedar-storage
| In production
| In production
|-
|-
Line 62: Line 42:
| General-purpose
| General-purpose
|
|
* [https://ccdb.computecanada.ca/resources/graham-compute Graham-Compute]
* graham-compute
* [https://ccdb.computecanada.ca/resources/graham-gpu Graham-GPU]
* graham-gpu
* [https://ccdb.computecanada.ca/resources/graham-storage Graham-Storage]
* graham-storage
| In production
| In production
|-
|-
Line 70: Line 50:
| General-purpose
| General-purpose
|
|
* [https://ccdb.computecanada.ca/resources/narval-compute Narval-Compute]
* narval-compute
* [https://ccdb.computecanada.ca/resources/narval-gpu Narval-GPU]
* narval-gpu
* [https://ccdb.computecanada.ca/resources/narval-storage Narval-Storage]
* narval-storage
| In production
| In production
|-
|-
Line 78: Line 58:
| Large parallel
| Large parallel
|
|
* [https://ccdb.computecanada.ca/resources/niagara-compute Niagara-Compute]
* niagara-compute
* [https://ccdb.computecanada.ca/resources/niagara-storage Niagara-Storage]
* niagara-storage
* hpss-storage
| In production
| In production
|}
|}


==Cloud - Infrastructure as a Service==
==Cloud - Infrastructure as a Service== <!--T:16-->
Our cloud systems are offering an ''Infrastructure as a Service'' (IaaS) where OpenStack is the main user interface.
Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.


<!--T:4-->
<!--T:4-->
{| class="wikitable"
{| class="wikitable"
|-
|-
! Name !! Description !! Status
! Name and link !! Sub-systems !! Description !! Status
|-
|-
| [[CC-Cloud Resources|Arbutus Cloud]] ||
| [[Cloud_resources#Arbutus_cloud|Arbutus cloud]]
* Compute intensive and persistent workloads
|
* vGPU nodes
* arbutus-compute-cloud
* arbutus-persistent-cloud
* arbutus-dcache
|
* VCPU, VGPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Shared filesystem storage (backed up)
* Object storage
* Floating IPs
* dCache storage
| In production
| In production
|-
|-
| [[CC-Cloud Resources|Béluga Cloud]] ||
| [[Cloud_resources#B.C3.A9luga_cloud|Béluga cloud]]
* Compute intensive and persistent workloads
|
* beluga-compute-cloud
* beluga-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
| In production
|-
|-
| [[CC-Cloud Resources|Cedar Cloud]] ||
| [[Cloud_resources#Cedar_cloud|Cedar cloud]]
* Compute intensive and persistent workloads
|
* cedar-persistent-cloud
* cedar-compute-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
| In production
|-
|-
| [[CC-Cloud Resources|Graham Cloud]] ||
| [[Cloud_resources#Graham_cloud|Graham cloud]]
* Compute intensive and persistent workloads
|
* graham-persistent-cloud
|
* VCPU, RAM
* Local ephemeral disk
* Volume and snapshot storage
* Floating IPs
| In production
| In production
|}
|}


</translate>
</translate>

Latest revision as of 14:23, 8 April 2022

Other languages:

Compute clusters

A general-purpose cluster is designed to support a wide variety of types of jobs, and is composed of a mixture of different nodes. We broadly classify the nodes as:

  • base nodes, containing typically about 4GB of memory per core;
  • large-memory nodes, containing typically more than 8GB memory per core;
  • GPU nodes, which contain graphic processing units.

The large parallel cluster Niagara is designed to support multi-node parallel jobs requiring more than 1000 CPU cores, although jobs as small as a single node are also supported there. Niagara is composed of nodes of a uniform design, with an interconnect optimized for large jobs.

All clusters have large, high-performance storage attached. For details about storage, memory, CPU model and count, GPU model and count, and the number of nodes at each site, please click on the cluster name in the table below.

List of compute clusters

Name and link Type Sub-systems Status
Béluga General-purpose
  • beluga-compute
  • beluga-gpu
  • beluga-storage
In production
Cedar General-purpose
  • cedar-compute
  • cedar-gpu
  • cedar-storage
In production
Graham General-purpose
  • graham-compute
  • graham-gpu
  • graham-storage
In production
Narval General-purpose
  • narval-compute
  • narval-gpu
  • narval-storage
In production
Niagara Large parallel
  • niagara-compute
  • niagara-storage
  • hpss-storage
In production

Cloud - Infrastructure as a Service

Our cloud systems are offering an Infrastructure as a Service (IaaS) based on OpenStack.

Name and link Sub-systems Description Status
Arbutus cloud
  • arbutus-compute-cloud
  • arbutus-persistent-cloud
  • arbutus-dcache
  • VCPU, VGPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Shared filesystem storage (backed up)
  • Object storage
  • Floating IPs
  • dCache storage
In production
Béluga cloud
  • beluga-compute-cloud
  • beluga-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
In production
Cedar cloud
  • cedar-persistent-cloud
  • cedar-compute-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
In production
Graham cloud
  • graham-persistent-cloud
  • VCPU, RAM
  • Local ephemeral disk
  • Volume and snapshot storage
  • Floating IPs
In production