Research proposal
Separation of Linguistic Mechanisms
Can we intervene on one linguistic property of a language model without changing others?
- Question
- Which mechanisms are shared between linguistic properties, and which can be separated?
- Approach
- Compare controlled linguistic contrasts, identify shared and distinct internal representations, and test candidate mechanisms through causal interventions.
A current thread in mechanistic interpretability: understanding when linguistic properties rely on distinct, shared, or compositional mechanisms.