method
active
method:sparse-probingSparse Probing
Method from Gurnee et al. 2023 for finding feature directions including individual neuron analysis
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Top-down interpretability approach studying linguistic properties at various residual stream stages; contrasted with the paper's bottom-up mechanistic approach
- Coding scheme where qualities are represented by few neurons with continuous similarity relations.
- Interpretability tools that decode information from internal model activations; here, linear probes are used for data attribution.
- Probing approach avoiding supervision to sidestep complexity-accuracy tradeoff
- Technique of reading out model beliefs from internal activations before the final answer token is generated
- Earlier interpretability method applying classifiers to DNN hidden representations; shares complexity-accuracy dilemma with causal abstraction
- The extracted set of sparse interpretable features from model embeddings via SAEs
- A goal in mechanistic interpretability to identify sparse computational subgraphs; VPD promotes sparse parameter circuits.