Vocabulary

Also: vocab size

The fixed set of tokens a model can read or emit, typically tens to hundreds of thousands of entries. Its size sets the width of the embedding table and of the final output layer.

A definition is not an understanding. This is taught properly in What a token is, part of Tokenization.

Learn this properly

Terms from the same topic