Allocations and compute scheduling: Difference between revisions

Jump to navigation Jump to search

Allocations and compute scheduling (view source)

Revision as of 16:00, 21 September 2021

794 bytes removed ,  3 years ago
no edit summary
No edit summary
No edit summary
Line 23: Line 23:


<!--T:36-->
<!--T:36-->
[[File:Select view group usage edit.png|thumb|Navigation to "View Group Usage" at the Compute Canada portal. ]]
[[File:Select view group usage edit.png|thumb|Navigation to ''View Group Usage'']]
Summaries of account usage can be explored by logging into ccdb.computecanada.ca and navigating to ‘My Account’ > ‘View Group Usage’. CPU and GPU core year values are calculated based on the quantity of the resources allocated to jobs on the clusters. It is important to note that the values summarized at the View Group Usage pages do not represent core-equivalent measures such that, in the case of large memory jobs, the usage values will not match the cluster scheduler’s representation of the account usage. <br clear=all>
Information on the usage of compute resources by your groups can be found by logging into the CCDB and navigating to ''My Account > View Group Usage''.


CPU and GPU core year values are calculated based on the quantity of the resources allocated to jobs on the clusters. It is important to note that the values summarized in these pages do not represent core-equivalent measures such that, in the case of large memory jobs, the usage values will not match the cluster scheduler’s representation of the account usage.


<!--T:37-->
<!--T:37-->
[[File:Ccdb view use by compute resource.png|thumb|View of group usage by compute resource.]]
The first tag bar offers these options:
The initial view of the usage at the View Group Usage page is divided up ‘By Compute Resources” (specific compute clusters, e.g. Beluga, Cedar, etc) which summarizes together the usage of all groups that the logged in user either owns or belongs to. The initial view begins with the current allocation year (starting on April 1st) up to the current date. <br clear=all>
: '''By Compute Resource''': cluster on which jobs are submitted;
: '''By Resource Allocation Project''': projects to which jobs are submitted;
: '''By Submitter''': user that submits the jobs;
: '''Storage usage''' is discussed in [[Storage and file management]].  


<!--T:38-->
=== Usage by compute resource===
[[File:ccdb_view_use_by_compute_resource.png|thumb|CPU and GPU usage by compute resource]]
This view shows the usage of compute resources per cluster used by groups owned by you or of which you are a member for the current allocation year starting April 1st. The tables contain the total usage to date as well as the projected usage to the end of the current allocation period.


<!--T:38-->
[[File:Ccdb view use by compute resource monthly.png|thumb|Usage by compute resource with monthly breakdown.]]
Using the top selection bar of the View Group Usage page compute usage summaries can be grouped “By Compute Resources” (specific compute clusters, e.g. Beluga, Cedar, etc), “By Resource Allocation Project” (corresponding to the group account that jobs are submitted to, e.g. def-*, rrg-*, etc.), or “By Submitter” (corresponding to the specific users that submitted the jobs). The top selection bar also provides an option to display “Storage Usage”.


<!--T:39-->
<!--T:39-->
The table summaries for the current year provide a row for each compute resource (cluster), the “Total CPU Usage (in core years)” to date as well as the “Projected CPU Usage (in core years)” which assumes that the throughput achieved to date will be maintained for the remainder of the allocation period.
From the ''Extra Info'' column of the usage table ''Show monthly usage'' can be clicked to display a further breakdown of the usage by month for the specific cluster row in the table. By clicking ''Show submitter usage'', a similar breakdown is displayed for the specific users submitting the jobs on the cluster.
[[File:ccdb_view_use_by_compute_resource_monthly.png|thumb|Usage by compute resource with monthly breakdown]]


<!--T:40-->
<!--T:40-->
The “Year:” selection bar in the top panel of the View Group Usage page provides archival summaries of “Total CPU Usage (in core years)” for previous allocation years for which the “Projected CPU Usage” column is eliminated.
===Usage by resource allocation project===
[[File:Ccdb view use by compute resource monthly proj edit.png|thumb|Usage by Resource Allocation Project with monthly breakdown]]
Under this tab, a third tag bar displays the RAPIs (Resource Allocation Project Identifiers) for the selected allocation year. The tables contain detailed information for each allocation project and the resources used by the projects on all of the clusters. The top of the page summarizes information such as the account name (e.g. def-, rrg- or rpp-*, etc), the project title and ownership, as well as allocation and usage summaries.


<!--T:41-->
<!--T:41-->
The “Extra Info” columns of the summary tables provide further breakdowns by “monthly” or “submitter” usage respectively. <br clear=all>
===Usage by submitter===
 
Usage can also be displayed grouped by the users that submitted jobs from within the resource allocation projects (group accounts). The view shows the usage for each user aggregated across systems.
<!--T:42-->
[[File:Ccdb view use by submitter summary edit.png|thumb|Usage by Resource Allocation Project with monthly breakdown]]
[[File:Ccdb view use by compute resource monthly proj edit.png|thumb|Usage by Resource Allocation Project with monthly breakdown.]]
Selecting from the list of users will display that user’s usage broken down by cluster. Like the group summaries, these user summaries can then be broken down monthly by clicking the Show monthly usage link of the Extra Info column of the CPU/GPU Usage (in core/GPU] years) table for the specific Resource row.  
The scheduling software implements the fair share usage policy across all Resource Allocation Projects (group accounts) on the specific cluster. Selecting the “By Resource Allocation Project” displays the summaries of specific project allocations and their usage on the clusters. This will display a new selection bar at the top of the View Group Usage page listing the available RAPIs (Resource Allocation Project Identifiers) for the selected allocation year. Selecting a specific RAPI displays various summary fields including the account name (e.g. def-*, rrg-* or rpp-*, etc), the project name and ownership as well as allocation and usage summaries. A single Resource Allocation Project may have allocations and usage on several clusters. This view divides the project’s allocations and usage uniquely across the clusters. The summary for the current allocation year provides columns for the “Resource” containing the allocation, “Allocations” details, “Total Core-Years Allocated”, “Total CPU Usage (in core years)”, “Utilization” expressed as a percentage of the allocation used, “Projected CPU Usage (in core years)” and “Projected Utilization” expressed as a percentage of the allocation projected use. <br clear=all>


== What happens if my group overuses my CPU or GPU allocation? == <!--T:32-->
== What happens if my group overuses my CPU or GPU allocation? == <!--T:32-->
Diane27
rsnt_translations
56,420

edits

Retrieved from "https://docs.alliancecan.ca/wiki/Special:MobileDiff/103696"

Navigation menu