Skip to content

Commit

Permalink
Update slides
Browse files Browse the repository at this point in the history
  • Loading branch information
trossi committed Jun 20, 2024
1 parent 85b6a6b commit 272f412
Showing 1 changed file with 10 additions and 8 deletions.
18 changes: 10 additions & 8 deletions gpu-hip/docs/05-multi-gpu.md
Original file line number Diff line number Diff line change
Expand Up @@ -288,20 +288,22 @@ int omp_target_memcpy(void *dst, const void *src, size_t size, size_t dstOffset,
* If direct peer to peer access is not available or implemented, the functions should fall back to a normal copy through host memory


# Three levels of parallelism
# Summary {.section}

<small>
# Three levels of parallelism

1. GPU -- GPU threads on the multiprocessors
<div class="column">
1. GPU: GPU threads
* Parallelization strategy: HIP, OpenMP, SYCL, Kokkos, OpenCL
2. Node -- Multiple GPUs and CPUs
2. Node: Multiple GPUs and CPUs
* Parallelization strategy: MPI, Threads, OpenMP
3. Supercomputer -- Many nodes connected with interconnect
3. Supercomputer: Many nodes connected with interconnect
* Parallelization strategy: MPI between nodes
</div>

</small>

![](img/parallel_regions.png){width=60%}
<div class="column">
![](img/parallel_regions.png){width=99%}
</div>


# Summary
Expand Down

0 comments on commit 272f412

Please sign in to comment.