concept
active
concept:v-valuesV values
In attention, value vectors that carry the information future positions should receive.
Neighborhood — ranked by edge-count
Papers (1)
paper
Artifacts (1)
artifact
- Original thread by janus explaining transformer information highways and introspection capabilities, posted on X.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Janus's interpretive claim about value vectors.
- Probability of sensory input expected by an agent, aligning value maximization with surprise minimization.
- A VS variant that generates k responses with probabilities across multiple conversation turns for additional diversity
- In attention, query vectors that ask 'where in the past should I look?' given the current state.
- The baseline variant of Verbalized Sampling that asks for k responses with their probabilities in a single LLM call
- Spreadsheet-like rule defining how a rectangle's or object's value is computed; enables data-driven behavior across all Playground tools.
- A form of attention head composition where W_V reads from a subspace affected by a previous head, creating virtual attention heads
- In attention, key vectors that advertise 'where in the future should look here?'