Asked about Isolating what actually caused the improvement
How many seeds should you run?
An answer that works
Enough to know the variance, usually three to five for expensive runs and more when cheap. Without knowing the spread you cannot say whether a difference means anything.
Reading an answer is not being able to give one. The section that teaches this is Isolating what actually caused the improvement, 5 hours of Experiment design.
Learn this properlyAlso asked about Experiment design
How do you know your improvement is real?What is an ablation study and why does it matter?What is a confound, and how do you control for it?Why decide your metric before running an experiment?Your new method beats the baseline by 0.8 points on one run. How do you decide if it is real?Your method has three components. How do you show which ones matter?