38,760
edits
(Updating to match new version of source page) |
(Updating to match new version of source page) |
||
Line 1: | Line 1: | ||
<languages /> | <languages /> | ||
You have just received your Compute Canada account. Welcome! Now what do you do? This | You have just received your Compute Canada account. Welcome! Now what do you do? This page is intended to help you find your way through the technical documentation on Compute Canada services and systems. | ||
If you want to know how to get a Compute Canada account, see [https://www.computecanada.ca/research-portal/account-management/apply-for-an-account/ Apply for an account]. | ''Note: If you want to know how to get a Compute Canada account, see [https://www.computecanada.ca/research-portal/account-management/apply-for-an-account/ Apply for an account].'' | ||
==What do you want to do?== | ==What do you want to do?== | ||
If you | |||
* If you are an experienced HPC user and are ready to log onto a cluster, skip to section ''What resources are available?'', below. | |||
* would like some training, you can | * If you would like some training, you can | ||
** read about how to [[SSH| | ** read about how to connect to our HPC systems with [[SSH|SSH]]; | ||
** read an introduction to | ** read an introduction to [[Linux introduction|Linux]] systems; | ||
** read about how to [[Transferring files|transfer files]] to and from | ** read about how to [[Transferring files|transfer files]] to and from Compute Canada systems; | ||
** look for a training event on [https://www.computecanada.ca/calendar/ this schedule] | ** look for a training event on [https://www.computecanada.ca/calendar/ this schedule]. <!-- ** Online training materials are here --> | ||
<!-- ** Online training materials are here --> | * If you want to know which software and hardware are available for a specific discipline, a series of discipline guides is in preparation. At this time, you can consult the guide on | ||
* want to know | ** [[Visualization]]. | ||
** [[Visualization]] | * If you have hundreds of gigabytes of data to move across the network, read about the [[Globus]] file transfer services. | ||
* have hundreds of gigabytes of data to move across the network, read about [[Globus]] file transfer services | * If you want to experiment with software that doesn’t run well on our HPC systems, please read about Compute Canada [[CC-Cloud|Cloud resources]]. | ||
* want to experiment with software that doesn’t run well on our HPC systems, | |||
For any other questions, you might try the Search box in the upper right corner of this page, the [[Compute Canada Documentation| | For any other questions, you might try the ''Search'' box in the upper right corner of this page, the main page for [[Compute Canada Documentation|Compute Canada Documentation]], or [[Technical support|contact us]] by email. | ||
==What resources are available?== | ==What resources are available?== | ||
Line 25: | Line 24: | ||
===New resources (deployed in 2016 or after)=== | ===New resources (deployed in 2016 or after)=== | ||
Compute Canada has begun to renew its infrastructure | Compute Canada has begun to renew its infrastructure in 2016. The first phase of the new deployment is composed of four new clusters, called Arbutus (GP1), Cedar (GP2), Graham (GP3) and Niagara (LP). | ||
Arbutus, an extension of the West cloud, now has all its additional compute nodes and will be equipped with additional storage. | |||
While the [https://www.computecanada.ca/research-portal/accessing-resources/migration/ details] are still subject to change, Cedar (GP2) and Graham (GP3) will be general purpose clusters composed of a variety of nodes including large memory nodes and nodes with accelerators. | |||
Niagara (LP) will be a large parallel cluster with nodes interconnected by a fast network. | |||
===Legacy resources (deployed before 2016)=== | ===Legacy resources (deployed before 2016)=== | ||
[https://www.computecanada.ca/research-portal/national-services/compute/ Computing resources] which were installed between 2004 and 2015 and are scheduled to be decommissioned in the next few years are referred to as ''legacy resources''. The legacy resources are administered by regional organizations, one of [http://www.ace-net.ca/ ACENET], [http://cac.queensu.ca/ the Centre for Advanced Computing], [http://www.calculquebec.ca/en/ Calcul Québec], [http://www.scinethpc.ca/ SciNet], [https://www.sharcnet.ca/my/front/ SHARCNET], and [https://www.westgrid.ca/ WestGrid]. To use a legacy resource you must have an account with one of these entities, which you can do through [https://ccdb.computecanada.ca/me/facilities this page]. Resources deployed during and after 2016 will not require this step, nor | [https://www.computecanada.ca/research-portal/national-services/compute/ Computing resources] which were installed between 2004 and 2015 and are scheduled to be decommissioned in the next few years are referred to as ''legacy resources''. The legacy resources are administered by regional organizations, one of [http://www.ace-net.ca/ ACENET], [http://cac.queensu.ca/ the Centre for Advanced Computing], [http://www.calculquebec.ca/en/ Calcul Québec], [http://www.scinethpc.ca/ SciNet], [https://www.sharcnet.ca/my/front/ SHARCNET], and [https://www.westgrid.ca/ WestGrid]. To use a legacy resource you must have an account with one of these entities, which you can do through [https://ccdb.computecanada.ca/me/facilities this page]. Resources deployed during and after 2016 will not require this step, nor will the two [[CC-Cloud|clouds]]. | ||
Most [https://www.computecanada.ca/research-portal/national-services/compute/ legacy clusters] are classified as either capacity clusters or capability clusters. ''Capacity clusters'' contain nodes connected to each other by a relatively slow Ethernet network, while the ''capability clusters'' have a fast network, usually InfiniBand. Large parallel jobs will run better on capability clusters than capacity clusters, while smaller jobs will run almost anywhere. | Most [https://www.computecanada.ca/research-portal/national-services/compute/ legacy clusters] are classified as either capacity clusters or capability clusters. ''Capacity clusters'' contain nodes connected to each other by a relatively slow Ethernet network, while the ''capability clusters'' have a fast network, usually InfiniBand. Large parallel jobs will run better on capability clusters than capacity clusters, while smaller jobs will run almost anywhere. | ||
There are some specialty clusters among the legacy resources. Applications which require more than 512 GB | There are some specialty clusters among the legacy resources. Applications which require more than 512 GB of memory per node require ''large shared memory systems''. Compute Canada has four such systems: | ||
* Hungabee hosted by WestGrid | * Hungabee hosted by WestGrid | ||
* M9000 hosted by the Centre for Advanced Computing | * M9000 hosted by the Centre for Advanced Computing | ||
Line 38: | Line 43: | ||
* Fortier hosted by SHARCNET | * Fortier hosted by SHARCNET | ||
Compute Canada also has clusters equipped with accelerators such as [https://en.wikipedia.org/wiki/General-purpose_computing_on_graphics_processing_units GPUs] and Intel [https://en.wikipedia.org/wiki/Xeon_Phi Xeon Phis]. If your application | Compute Canada also has clusters equipped with accelerators such as [https://en.wikipedia.org/wiki/General-purpose_computing_on_graphics_processing_units GPUs] and Intel [https://en.wikipedia.org/wiki/Xeon_Phi Xeon Phis]. If your application calls for from such accelerators, you will find them on the following legacy systems: | ||
* Helios, Hades and Guillimin, hosted by Calcul Québec | * Helios, Hades and Guillimin, hosted by Calcul Québec | ||
* Parallel, hosted by WestGrid | * Parallel, hosted by WestGrid | ||
Line 47: | Line 52: | ||
Finally, Compute Canada also hosts two [[CC-Cloud|clouds]] called East Cloud and West Cloud, as well as [https://www.computecanada.ca/research-portal/national-services/storage/ storage resources] ranging from fast parallel filesystems to tape backup. | Finally, Compute Canada also hosts two [[CC-Cloud|clouds]] called East Cloud and West Cloud, as well as [https://www.computecanada.ca/research-portal/national-services/storage/ storage resources] ranging from fast parallel filesystems to tape backup. | ||
== | ==What resources should I use?== | ||
This question is hard to answer because of the range of needs Compute Canada serves, and because of the enormous variety of resources we have available --- especially during the 2016-2018 renewal period. If the descriptions above are insufficient, contact Compute Canada’s [[technical support]] or your [https://www.computecanada.ca/about/partners/ regional support]. | This question is hard to answer because of the range of needs Compute Canada serves, and because of the enormous variety of resources we have available --- especially during the 2016-2018 renewal period. If the descriptions above are insufficient, contact Compute Canada’s [[technical support]] or your [https://www.computecanada.ca/about/partners/ regional support]. | ||
In order to identify the best resource to use, we may ask | In order to identify the best resource to use, we may ask specific questions, such as: | ||
* What software do you want to use? | * What software do you want to use? | ||
** Does | ** Does the software require a commercial license? | ||
** Can | ** Can the software be used non-interactively? That is, can it be controlled from a file prepared prior to its execution rather than through the graphical interface? | ||
** Can it run on the Linux operating system? | ** Can it run on the Linux operating system? | ||
* How much memory, time, computing power, accelerators, storage, network bandwidth and so forth --- are required by a typical job? Rough estimates are fine. | * How much memory, time, computing power, accelerators, storage, network bandwidth and so forth --- are required by a typical job? Rough estimates are fine. | ||
* How frequently will you need to run this | * How frequently will you need to run this type of job? | ||
You may know the answer to these questions or not. If you do not, our technical support team is there to help you find the answers. Then they will be able to direct you to the most appropriate resources for your needs. | You may know the answer to these questions or not. If you do not, our technical support team is there to help you find the answers. Then they will be able to direct you to the most appropriate resources for your needs. |