concept
active
concept:q-valuesQ values
In attention, query vectors that ask 'where in the past should I look?' given the current state.
Neighborhood — ranked by edge-count
Papers (1)
paper
Artifacts (1)
artifact
- Original thread by janus explaining transformer information highways and introspection capabilities, posted on X.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- In attention, key vectors that advertise 'where in the future should look here?'
- Janus's interpretive claim about query vectors.
- Probability of sensory input expected by an agent, aligning value maximization with surprise minimization.
- In attention, value vectors that carry the information future positions should receive.
- Model-free RL algorithm used in experimental comparison; employs ε-greedy exploration.
- A form of attention head composition where W_Q reads from a subspace affected by a previous head, allowing more complex attention patterns
- Spreadsheet-like rule defining how a rectangle's or object's value is computed; enables data-driven behavior across all Playground tools.
- Expected evidence for preferred outcomes; utility-weighted term in expected free energy.