concept
active
concept:v-valuesV values
In attention, value vectors that carry the information future positions should receive.
Neighborhood — ranked by edge-count
Papers (1)
paper
Artifacts (1)
artifact
- Original thread by janus explaining transformer information highways and introspection capabilities, posted on X.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Janus's interpretive claim about value vectors.
- Probability of sensory input expected by an agent, aligning value maximization with surprise minimization.
- In attention, query vectors that ask 'where in the past should I look?' given the current state.
- Spreadsheet-like rule defining how a rectangle's or object's value is computed; enables data-driven behavior across all Playground tools.
- A form of attention head composition where W_V reads from a subspace affected by a previous head, creating virtual attention heads
- In attention, key vectors that advertise 'where in the future should look here?'
- Ternary relation xy|z defined on leaves of a tree as z ≰ x ∨ y; encodes the structure of evolutionary trees.
- A dynamic programming method for computing optimal value functions and policies in known MDPs.