QK Circuit

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Recurrent Logic Circuitconcept0.741
  The key novel property of DiffLogic CA — logic gate networks that are recurrent both spatially and temporally
• Equivariant Circuitconcept0.724
  A circuit exhibiting symmetry such that the weights rotate with the orientation of the feature they detect
• Q-Compositionconcept0.721
  A form of attention head composition where W_Q reads from a subspace affected by a previous head, allowing more complex attention patterns
• Circuits Threadframework0.720
  An open scientific collaboration hosted on Distill slack studying the inner workings of neural networks via zoomed-in mechanistic investigation
• Circuit Motifconcept0.714
  A recurring, abstract pattern found in circuits (e.g., equivariance, unioning over cases), inspired by circuit motifs in systems biology
• Sparse circuitsconcept0.713
  A goal in mechanistic interpretability to identify sparse computational subgraphs; VPD promotes sparse parameter circuits.
• Concordance heads (QK circuits) could serve as the consistency-checking circuit for distinguishing intended vs. unintended outputshypothesis0.711
  Speculated mechanism for prefill detection.
• Circuits Frameworkframework0.708
  Mechanistic interpretability framework for understanding neural network computation as circuits of features