method
active
method:head-contribution-scoreHead Contribution Score
Dot product between head output persona vector and aggregate attention-output persona vector, used to identify Style Modulation Heads
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Confirms that head importance is driven by direction, not just output norm magnitude
- Head selecting relevant content; generalizes beyond multiple choice.
- Validates the Head Contribution Score as a proxy for functional importance
- Configurable scatter plot of heads by metrics to find interesting heads.
- QK circuit heads hypothesized to measure likelihood of an output given prior activations, used in prefill detection.
- Ranks all heads by attention on a pair to trace composition.
- Dot product between hidden state and concept vector averaged across 5-layer window around best layer; measures model's internal emotive state
- Summary of case studies.