Asked about Prompt, retrieve or fine-tune
What is the cost of fine-tuning beyond the training run?
An answer that works
A dataset you must build and keep current, redoing the work when you change base model, and a maintenance obligation a prompt does not have. That is why it sits last in the order after prompting, examples and retrieval.
Reading an answer is not being able to give one. The section that teaches this is Prompt, retrieve or fine-tune, 8 hours of Fine-tuning.
Learn this properlyAlso asked about Fine-tuning
When would you fine-tune rather than use RAG?What is LoRA?What is distillation?How much data do you need to fine-tune?Where do the examples come from?What is catastrophic forgetting?How do you know the fine-tune actually beat the prompt?You have five fine-tunes of one base model to serve. Merged or separate adapters?
All 13 questions on Fine-tuning