finding
active
finding:multiple-choice-heads-attend-via-query-side-answer-needed-features-and-bias-to-key-side-correct-answer-features-inhibited-by-false-statement-featuresMultiple-choice heads attend via query-side answer-needed features and bias to key-side correct-answer features, inhibited by false-statement features
QK attribution for MC heads.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- MC interpretation.
Hypotheses (1)
hypothesis
- Prior hypothesis now confirmed.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Perturbation validation.
- None of the top-activating examples for the answer selection head are multiple choice questionsfinding0.801Shows broader behavior.
- Does the answer selection head really implement one behavior, or many behaviors that share a common template?question0.798Raised by disjoint feature sets.
- Prediction for future decomposition.
- Best guess but not fully convinced; lacks crisp text description to test.
- Interpretation of steering asymmetry.
- Supports monosemantic reading.
- Generalizes beyond multiple choice.