Autoregressive

Generating one element at a time and feeding each output back in as input for the next. It is why a reply's first token costs one pass over the prompt and every token after it costs another pass.

A definition is not an understanding. This is taught properly in From attention to a full language model, part of Transformers & attention.

Learn this properly

Terms from the same topic

Transformer Attention Self-attention Multi-head attention Query, key and value Causal mask Positional encoding RoPE