concept
active
concept:q-compositionQ-Composition
A form of attention head composition where W_Q reads from a subspace affected by a previous head, allowing more complex attention patterns
Neighborhood — ranked by edge-count
Thinkers (1)
thinker
- Neel NandastudiesExternal commenter; resolved apparent counterexample to linear representation hypothesis
Concepts (1)
concept
- K-Compositionassociated_withA form of attention head composition where W_K reads from a subspace affected by a previous head; central to how induction heads are implemented
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The wiring together of processes to form new processes in process theory
- A form of attention head composition where W_V reads from a subspace affected by a previous head, creating virtual attention heads
- Integration of quantum mechanics with compositional AI principles; extends classical compositional reasoning to quantum domain.
- Modeling function application via feedback loops between processes, ping-ponging tokens.
- Composition where a whole cannot be meaningfully decomposed into its original parts, central to Schrödinger compositional theory
- Central concept: how meaning of wholes depends on meanings of parts and their structural arrangement; multiple formulations explored (Frege, Schrödinger, Whitehead, LEGO).
- Quantum computing leveraging compositionality for circuit design, error correction, and more
- Model-free RL algorithm used in experimental comparison; employs ε-greedy exploration.