concept
active
concept:ov-circuit

OV Circuit

The circuit formed by W_U W_OV^h W_E that describes how a given token affects output logits if attended to

Neighborhood — ranked by edge-count

Methods (1)

method
  • A conceptual technique of fixing attention patterns to make the transformer a purely linear function of tokens, enabling independent analysis of OV and QK circuits

Concepts (1)

concept
  • Copying Matrix
    associated_with
    An OV circuit matrix that maps tokens to increasing the logit of those same tokens; detectable via positive eigenvalues

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.