Comment by addag

I'm new to the mechanistic interpretability field, but from what I have read insofar, a lot of papers have relied on ablation/causal interventions to prove the faithfulness of their models.

Do you have a simple explanation of why this level of proof is not sufficient?