Asked about Prompt, retrieve or fine-tune
When would you fine-tune rather than use RAG?
An answer that works
When the need is consistent form rather than facts: a fixed output format, a domain style, or making a small model good enough at one narrow task to cut cost and latency. If the model is missing knowledge, that is retrieval, because fine-tuning does not reliably install facts and cannot be updated without retraining.
Reading an answer is not being able to give one. The section that teaches this is Prompt, retrieve or fine-tune, 8 hours of Fine-tuning.
Learn this properlyAlso asked about Fine-tuning
What is LoRA?What is the cost of fine-tuning beyond the training run?What is distillation?How much data do you need to fine-tune?Where do the examples come from?What is catastrophic forgetting?How do you know the fine-tune actually beat the prompt?You have five fine-tunes of one base model to serve. Merged or separate adapters?
All 13 questions on Fine-tuning