GPU Programming

  1. Advanced CUDA Programming
    1. Dynamic Parallelism
      1. Nested Kernel Launches
        1. Parent-Child Relationships
          1. Synchronization Semantics
            1. Memory Visibility
            2. Use Cases and Applications
              1. Adaptive Algorithms
                1. Tree Traversal
                  1. Recursive Problems
                  2. Performance Considerations
                    1. Launch Overhead
                      1. Memory Management
                        1. Debugging Challenges
                      2. Multi-GPU Programming
                        1. Multi-GPU Architectures
                          1. Peer-to-Peer Access
                            1. Memory Topology
                            2. Programming Patterns
                              1. Data Parallelism
                                1. Model Parallelism
                                  1. Pipeline Parallelism
                                  2. Communication Strategies
                                    1. Direct Memory Access
                                      1. Unified Memory
                                        1. NCCL Library
                                      2. CUDA Libraries Ecosystem
                                        1. Mathematical Libraries
                                          1. cuBLAS
                                            1. cuSPARSE
                                              1. cuSOLVER
                                                1. cuFFT
                                                2. Machine Learning Libraries
                                                  1. cuDNN
                                                    1. TensorRT
                                                      1. cuML
                                                      2. Utility Libraries
                                                        1. Thrust
                                                          1. CUB
                                                            1. cuRAND
                                                              1. NPP
                                                            2. Interoperability
                                                              1. Graphics API Integration
                                                                1. OpenGL Interop
                                                                  1. DirectX Interop
                                                                    1. Vulkan Interop
                                                                    2. CPU Library Integration
                                                                      1. MPI Integration
                                                                        1. OpenMP Integration
                                                                          1. Threading Libraries
                                                                        2. Specialized Hardware Features
                                                                          1. Tensor Cores
                                                                            1. Architecture Overview
                                                                              1. Mixed-Precision Computing
                                                                                1. Programming Models
                                                                                  1. Performance Optimization
                                                                                  2. RT Cores
                                                                                    1. Ray Tracing Acceleration
                                                                                      1. OptiX Integration
                                                                                        1. Hybrid Rendering

                                                                                    Previous

                                                                                    5. Performance Optimization and Profiling

                                                                                    Go to top

                                                                                    Next

                                                                                    7. OpenCL Programming