Awesome GPU Notes

GPU and CUDA Documents

GPU architecture

• nvidia-ampere-architecture-whitepaper
• TESLA V100 GPU ARCHITECTURE

CUDA

• CUDA Programming Guide

• CUDA Best Practice Guide

• CUDA Sample Code

  • sgemm

Topics

• https://developer.nvidia.com/blog/inside-volta/
• https://developer.nvidia.com/blog/cuda-pro-tip-optimized-filtering-warp-aggregated-atomics/
• https://developer.nvidia.com/blog/cooperative-groups/

Inference

TensorRT

Triton

Training

• distributed training

Tools

NVIDIA System Management (nvidia-smi and NVML)

TBA

NVIDIA Nsight Systems

• official site
• Document home

Videos:

• University of Illinois ECE 408 - Nsight Compute and Nsight Systems:

  • https://www.youtube.com/watch?v=uN2qju175aE
  • https://www.youtube.com/watch?v=yI137sSOlkU
  • https://www.youtube.com/watch?v=YHrmnaPgFfY
  • https://www.youtube.com/watch?v=UNX0KNMQlW8

• NV: what the profiler is telling you

Modulus, AI for science

• Deep Learning for Science and Engineering, George Karniadakis, Professor, Brown University
• DLI
• End-to-End AI for Science