claim
active
claim:the-reflexive-mechanism-is-needed-because-causal-attention-prevents-lexical-retrieval-when-target-precedes-query-in-a-groupThe reflexive mechanism is needed because causal attention prevents lexical retrieval when target precedes query in a group
Architectural explanation.
Source paper
extracted_from(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Central thesis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- §D.3.
- When lexical/reflexive targets absent from original, model falls back to noisy positional mechanismfinding0.809Fig. 28–29.
- Lexical and reflexive mechanisms provide sharper signals refining the diffuse positional signalclaim0.799Takeaway.
- Reflexive signal retrieved from entity tokens.
- Lexical signal can be derived locally from query token while reflexive must be retrieved from entity tokenshypothesis0.784Tested with knockout.
- Replication of Wu et al. 2023 finding; DAS expressivity concern validated in CausalGym setup
- Central thesis of the paper
- Mechanism by which activation of an emotion feature sometimes leads to later suppression of that same featurequestion0.755Identified research gap: the paper observes anti-persistence but has no explanation for it