-
Book Overview & Buying
-
Table Of Contents
GPU-Accelerated Computing with Python 3 and CUDA
By :
This section briefly introduces advanced low-level features that warrant further exploration for high-performance CUDA programming in Python.
The examples in this book have primarily relied on global memory, shared memory, registers, and hardware-managed caches (L1 and L2). These form the core memory hierarchy that most CUDA programs rely on.
Other types of memory have been mentioned only in passing. These additional memory spaces can be useful in specific situations, particularly when optimizing memory access patterns or interfacing with specialized hardware features. Therefore, this section provides a guide to the more niche types of memory in CUDA, both on the device and on the host.
The first memory space to mention is local memory. Local memory made a number of appearances in other chapters. Conceptually, local memory stores data that is private to each thread. Scalar values stored in variables inside...