claim
active
claim:multiple-choice-heads-have-a-default-bias-to-attend-to-correct-answers-strengthened-when-an-answer-is-neededMultiple-choice heads have a default bias to attend to correct answers, strengthened when an answer is needed
MC interpretation.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- QK attribution for MC heads.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretation of steering asymmetry.
- Does the answer selection head really implement one behavior, or many behaviors that share a common template?question0.811Raised by disjoint feature sets.
- None of the top-activating examples for the answer selection head are multiple choice questionsfinding0.800Shows broader behavior.
- Theme across prior and own work.
- Central theme.
- Best guess but not fully convinced; lacks crisp text description to test.
- Multiple choice answers are found by copying B to 1945, marking it correct, attending via query interaction, and copying B backhypothesis0.767Prior hypothesis now confirmed.
- Will a head perform 'the same algorithm' across prompts, or are individual heads polysemantic?question0.765Head polysemanticity.