Asked about Killing your own ideas early
What would you pre-register before running an experiment, and why bother?
An answer that works
The quantity, the comparison, the noise floor measured on the baseline first, and the threshold that makes me stop — plus an explicit list of the moves I am not allowed to make afterwards, such as changing the eval set or dropping seeds. The point is the timestamp: it is a promise made by someone not yet invested to the person who will be invested in six weeks and will find sincere reasons why the disappointing number does not count.
Reading an answer is not being able to give one. The section that teaches this is Killing your own ideas early, 3 hours of Research taste.
Learn this properlyAlso asked about Research taste
What would you work on if you had complete freedom?What do you think is overrated in the field right now?What surprised you recently?How do you find research problems?What do you do when a result surprises you?How do you decide whether to abandon a research direction?When is persisting after a negative result right?Pitch me a research project in two minutes.
All 11 questions on Research taste