Decode phase

Also: decode step, generation phase

The token-at-a-time part of inference after prefill, where each step reads the whole KV cache to produce one more token. It is limited by memory bandwidth rather than arithmetic, and it sets how fast text appears.

A definition is not an understanding. This is taught properly in Making generation faster, part of Quantization & inference optimisation.