Fine-tuning
Continuing to train an already-trained model on a smaller, narrower dataset so it fits a particular task, format or style.
What people get wrong
It teaches behaviour far more reliably than it adds knowledge. If the goal is for the model to know new facts, retrieval is usually the cheaper and more correctable answer.
A definition is not an understanding. This is taught properly in Prompt, retrieve or fine-tune, part of Fine-tuning.
Learn this properlyTerms from the same topic