Asked about The techniques, and what each establishes
What is superposition and what is the response to it?
An answer that works
Models represent more features than they have dimensions by packing them into overlapping directions, so individual neurons respond to several unrelated things. Sparse autoencoders, trained with many hidden units and a sparsity penalty, attempt to separate those features back out.
Reading an answer is not being able to give one. The section that teaches this is The techniques, and what each establishes, 5 hours of Interpretability.
Learn this properlyAlso asked about Interpretability
What is mechanistic interpretability?What is superposition and why does it make interpretability hard?What can interpretability actually establish today?What is the difference between probing and activation patching?Why is attribution not an explanation?What is the residual stream, and why is it a useful way to think about a transformer?Walk me through an activation patching experiment.How would you check whether an SAE feature really means what its label says?
All 10 questions on Interpretability