GPU Glossary
Device Hardware·1 min read

Load/Store UnitLSU

Units in a Streaming Multiprocessor that dispatch requests to load data from, or store data to, the GPU's memory subsystems.

Load/Store Units (LSUs) dispatch requests to load or store data to the GPU's memory subsystems.

The internal architecture of an H100 SM. Load/Store Units are shown in pink, along with the Special Function Units. Modified from NVIDIA's H100 white paper.
The internal architecture of an H100 SM. Load/Store Units are shown in pink, along with the Special Function Units. Modified from NVIDIA's H100 white paper.

For CUDA programmers, what matters most is which memory they talk to:

Both levels belong to the memory hierarchy of the CUDA programming model.