concept
active
concept:ov-circuitOV Circuit
The circuit formed by W_U W_OV^h W_E that describes how a given token affects output logits if attended to
Neighborhood — ranked by edge-count
Papers (1)
paper
Methods (1)
method
- A conceptual technique of fixing attention patterns to make the transformer a purely linear function of tokens, enabling independent analysis of OV and QK circuits
Concepts (1)
concept
- Copying Matrixassociated_withAn OV circuit matrix that maps tokens to increasing the logit of those same tokens; detectable via positive eigenvalues
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Prior circuit containing an inhibition head.
- Circuits active by default, e.g. can't-answer, suppressed by contrary evidence.
- A circuit exhibiting symmetry such that the weights rotate with the orientation of the feature they detect
- Across MCQ, sentiment, dialogue.
- Interpretability technique for identifying functional sub-circuits in neural networks, supported by pyvene
- Anthropic technique revealing computational pathways in Claude.
- An inference path across features that constitutes a computational subgraph in a trained model
- An open scientific collaboration hosted on Distill slack studying the inner workings of neural networks via zoomed-in mechanistic investigation