-
Book Overview & Buying
-
Table Of Contents
Deep Learning with C++
By :
This section shows how to turn performance-critical C++ code into fast, GPU-accelerated implementations with CUDA. We’ll start by identifying hotspots and establishing a CPU baseline, then map data-parallel work to kernels, choose effective grid/block sizes, and manage host-device memory to minimize transfers. You’ll learn practical techniques—coalesced access, shared-memory tiling, occupancy tuning, and stream-based overlap—along with when to reach for cuBLAS/cuFFT/cuDNN instead of hand-rolling code. We’ll measure with Nsight Systems/Compute, reason about speedups (Amdahl/Roofline), and iterate safely with correctness tests so that optimizations deliver real, reproducible gains.
CUDA provides a heterogeneous programming model in which the host code runs on the CPU and device code (kernels) runs on the GPU. The CPU and GPU each have their own memory spaces and execution contexts, often...