Pretraining

The long first training run on a very large, general corpus, where a model learns language and most of what it knows. It is where nearly all the compute goes and where capability comes from.