Asked about Isolating what actually caused the improvement
What is an ablation study and why does it matter?
An answer that works
Removing one component at a time and measuring the loss, to show each part contributes. It often reveals that something assumed important does not help, which is better to find yourself than in review.
Reading an answer is not being able to give one. The section that teaches this is Isolating what actually caused the improvement, 5 hours of Experiment design.
Learn this properlyAlso asked about Experiment design
How do you know your improvement is real?How many seeds should you run?What is a confound, and how do you control for it?Why decide your metric before running an experiment?Your new method beats the baseline by 0.8 points on one run. How do you decide if it is real?Your method has three components. How do you show which ones matter?