Bureaucrats, cc_docs_admin, cc_staff
337
edits
CUDA tutorial: Difference between revisions
→CUDA Block-Threading Model
| Line 61: | Line 61: | ||
= CUDA Block-Threading Model = | = CUDA Block-Threading Model = | ||
[[File:Cuda-threads-blocks.png|thumbnail|CUDA block-threading model where threads are organized into blocks while blocks are further organized into grid. ]] | |||
Given very large number of threads (and in order to achieve massive parallelism one has to use all the threads possible) in CUDA kernel, one needs to organize them somehow. in CUDA, all the threads are structured in threading blocks, the blocks are further organized into grids, as shown on FIg. In dividing the threads we make sure that the following is satisfied: | Given very large number of threads (and in order to achieve massive parallelism one has to use all the threads possible) in CUDA kernel, one needs to organize them somehow. in CUDA, all the threads are structured in threading blocks, the blocks are further organized into grids, as shown on FIg. In dividing the threads we make sure that the following is satisfied: | ||
* threads within a block cooperate via the shared memory | * threads within a block cooperate via the shared memory | ||
* threads in different blocks can not cooperate | * threads in different blocks can not cooperate | ||
[[File:Cuda-threads | In this model the threads within a block work on the same set of instructions (but perhaps with different data sets) and exchange data between each other via shared memory. Threads in other blocks do the same thing (see Figure). | ||
[[File:Cuda-threads.png|thumbnail|Threads within a block intercommunicate via shared memory . ]] | |||
= First CUDA C Program= | = First CUDA C Program= | ||