method
active
method:value-weighted-attention-pattern-visualization

Value-Weighted Attention Pattern Visualization

Visualizing attention patterns weighted by the norm of value vectors to better show how much information is moved from each position

Neighborhood — ranked by edge-count

Thinkers (1)

thinker
  • Recently introduced value-weighted attention patterns; the paper's approach mirrors and extends this

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Attention patterns scaled by the norm of the value vector at each source position, showing how large a vector is moved from each position
  • Method of optimizing input to cause a neuron to fire maximally, used to characterize what a neuron detects; establishes causal link
  • Visualizes feature interference matrix.
  • Neutral hint: correct few-shot answers marked with symbols.
  • Technique of building a fluid, three-dimensional vision by closing one's eyes, relying on words and feeling to avoid arbitrary graphical over-specification.
  • Process using Q, K, V to compute a heat map over K and weighted sum of V.
  • visual reasoningconcept0.744
    Visual reasoning tasks often interleaved with intermediate visual states; promising direction in the field.
  • Used to visualize LLM true/false representations, revealing clear linear structure separating true from false statements