concept
active
concept:qk-circuit

QK Circuit

The bilinear circuit formed by W_E^T W_QK^h W_E that determines which source token a destination token attends to

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Induction Heads
    associated_with
    Mechanistic circuits in transformers documented by Olsson et al. 2022, cited as evidence for pattern-repository assumption

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.