VRAM
Also: GPU memory, device memory
The memory attached to a GPU, holding weights, activations, optimiser state and the KV cache. It is usually the constraint that decides what you can run at all.
A definition is not an understanding. This is taught properly in What the hardware is doing, part of GPUs & accelerators.
Learn this properlyTerms from the same topic