Asked about Designing an ablation study, worked through
Your method has three components. How do you show which ones matter?
An answer that works
Run the baseline plus each component alone, and the full method minus each component, with several seeds each. Compare effects against seed variation, and check interactions for the components that matter with a small grid.
Then they push further
Removing component A costs 2 points but adding it alone to the baseline gains nothing. What does that mean?
A interacts with another component: it only helps in combination. The paper should describe it that way rather than claiming A is independently useful.
What gets marked up
Marked up for both add-one and remove-one directions, seeds, and recognising interactions.
Reading an answer is not being able to give one. The section that teaches this is Designing an ablation study, worked through, 4 hours of Experiment design.
Learn this properlyAlso asked about Experiment design