Asked about Where capability comes from
Why do models produce confident wrong answers?
An answer that works
The objective rewards plausible continuations, not calibrated uncertainty. Fluency and correctness were never separated during pretraining, so a wrong answer is produced with the same confidence as a right one.
Reading an answer is not being able to give one. The section that teaches this is Where capability comes from, 5 hours of Pretraining.
Learn this properlyAlso asked about Pretraining
How does a language model learn?What are scaling laws?Roughly what would it cost to pretrain a 7B model?Given a fixed compute budget, how do you choose model size and token count?What matters most for pretraining quality?Why deduplicate a pretraining corpus?Walk me through how a pretraining dataset is built.A new open model claims to beat a larger one on several benchmarks. How do you evaluate the claim?