Asked about Improving against a number
Why hold out a test split when you are only tuning prompts?
An answer that works
Because prompt tuning overfits exactly as model training does. Iterating against every case drives the score up while real performance stays flat. The held-out number is the one that still predicts reality.
Reading an answer is not being able to give one. The section that teaches this is Improving against a number, 6 hours of Eval-driven development.
Learn this properlyAlso asked about Eval-driven development