method
active
method:minimum-description-length-probingMinimum Description Length Probing
Probing approach that explicitly controls probe complexity via information-theoretic criteria
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Related to variational free energy; compressibility corresponds to complexity reduction in structure learning
- Earlier interpretability method applying classifiers to DNN hidden representations; shares complexity-accuracy dilemma with causal abstraction
- Method from Gurnee et al. 2023 for finding feature directions including individual neuron analysis
- Top-down interpretability approach studying linguistic properties at various residual stream stages; contrasted with the paper's bottom-up mechanistic approach
- Used to evaluate representation quality across VTAB tasks
- Probing approach avoiding supervision to sidestep complexity-accuracy tradeoff
- Method of using base models (no post-training) to observe spontaneous self-referential behaviors without confound of memorized introspection language.
- Interpretability tools that decode information from internal model activations; here, linear probes are used for data attribution.