concept
active
concept:q-composition

Q-Composition

A form of attention head composition where W_Q reads from a subspace affected by a previous head, allowing more complex attention patterns

Neighborhood — ranked by edge-count

Thinkers (1)

thinker
  • Neel Nanda
    studies
    External commenter; resolved apparent counterexample to linear representation hypothesis

Concepts (1)

concept
  • K-Composition
    associated_with
    A form of attention head composition where W_K reads from a subspace affected by a previous head; central to how induction heads are implemented

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • compositionconcept0.812
    The wiring together of processes to form new processes in process theory
  • V-Compositionconcept0.787
    A form of attention head composition where W_V reads from a subspace affected by a previous head, creating virtual attention heads
  • Integration of quantum mechanics with compositional AI principles; extends classical compositional reasoning to quantum domain.
  • Modeling function application via feedback loops between processes, ping-ponging tokens.
  • Composition where a whole cannot be meaningfully decomposed into its original parts, central to Schrödinger compositional theory
  • Compositionalityconcept0.761
    Central concept: how meaning of wholes depends on meanings of parts and their structural arrangement; multiple formulations explored (Frege, Schrödinger, Whitehead, LEGO).
  • Quantum computing leveraging compositionality for circuit design, error correction, and more
  • Q-learningmethod0.754
    Model-free RL algorithm used in experimental comparison; employs ε-greedy exploration.