OpenACC Tutorial - Introduction: Difference between revisions

Historically, computing has developed around Central Processing Units (CPU) that were optimized for sequential tasks. That is, they would complete only one compute operation during a given clock cycle. The frequency of these units steadily increased until about 2005, when the top speed of the high-end CPUs reached a plateau at around 4 GHz. Since then - for reasons well explained in [https://www.comsol.com/blogs/havent-cpu-clock-speeds-increased-last-years/ this article] - the usual CPU clock frequency has barely moved, and is even now often lower than 4 GHz. Instead, manufacturers started adding multiple computation cores within a single chipset, opening wide the era of parallel computing.

Yet, even as of 2022, sequential tasks still run the fastest on CPUs:

* first, they have direct access to the main computer memory, which can be very large;

* second, because of their very fast clock speed, they can run a small number of tasks very quickly.

But CPUs also have some weaknesses:

* they have relatively low memory bandwidth;