method
active
method:circuit-weight-readingCircuit Weight Reading
Reading a meaningful algorithm directly off of the weights linking neurons in a circuit
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretability technique for identifying functional sub-circuits in neural networks, supported by pyvene
- Fine-grained approach to identifying specific network components responsible for reflection, mentioned as future direction.
- An open scientific collaboration hosted on Distill slack studying the inner workings of neural networks via zoomed-in mechanistic investigation
- Advantage of DiffLogic CA over NCA — learned rules are pure binary logic circuits that can be visualized and analyzed
- Coefficient weighting each task loss in the MTL objective.
- Prior mechanistic interpretability work reverse-engineering vision models (InceptionV1); the direct predecessor this paper extends to language models
- A goal in mechanistic interpretability to identify sparse computational subgraphs; VPD promotes sparse parameter circuits.
- The space of the model's parameter matrices, where VPD operations take place.