question
active
question:what-is-interpretabilityWhat is interpretability?
Socio-philosophical open question.
Source paper
extracted_from(2025) · Lee Sharkey · Bilal I. Chughtai · Joshua Batson · Jack W. Lindsey +25
Neighborhood — ranked by edge-count
Papers (1)
paper
- Open Problems in Mechanistic Interpretabilityassociated_withmentions
Claims (1)
claim
- Social/philosophical problem.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The capability to explain model predictions; a central theme of the paper, with disruption profiles as vehicle.
- Proposed paradigm for evaluating interpretability work through empirical falsifiability rather than benchmarks or user studies
- Method using large language models (Claude) to generate and test explanations of features at scale
- Cases where subspace interventions change model behaviour through parallel pathways rather than the target feature
- Advantage of DiffLogic CA over NCA — learned rules are pure binary logic circuits that can be visualized and analyzed
- Second approach: propose concepts and find components corresponding to them.
- Diagnosis of the state of the interpretability field, drawing on Kuhn's framework
- Ian Goodfellow quote used to illustrate the pre-paradigmatic state of interpretability research