Asked about Doing interpretability research
How would you start an interpretability project?
An answer that works
Replicate a known result to validate the tooling, then pick one narrow behaviour in a small model, define a clean and corrupted setup, and run patching with controls against random components across many prompts, deciding in advance what would falsify the hypothesis.
Reading an answer is not being able to give one. The section that teaches this is Doing interpretability research, 3 hours of Interpretability.
Learn this properlyAlso asked about Interpretability
What is mechanistic interpretability?What is superposition and why does it make interpretability hard?What can interpretability actually establish today?What is the difference between probing and activation patching?What is superposition and what is the response to it?Why is attribution not an explanation?What is the residual stream, and why is it a useful way to think about a transformer?Walk me through an activation patching experiment.
All 10 questions on Interpretability