finding
active
finding:replacing-ivory-coast-with-zambia-drops-attention-to-a-from-0-87-to-0-08-lusaka-gives-0-10Replacing Ivory Coast with Zambia drops attention to 'a' from 0.87 to 0.08; Lusaka gives 0.10
Same-set suppression on real example.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Supported by geometry and 98% result but not a full account.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- QK attribution from Ivory to 'a' has top pair Ivory Coast query feature and Zambian key featurefinding0.788Explains attention edge.
- An earlier head attends from 'a' to chikumbuso and writes the Zambian features read by the suppression headfinding0.745K-composition example.
- Only Zambia is suppressed.
- Operation component is language-independent.
- Demonstrates non-robust heuristics installed by RL; slight prompt variation recovers large gap
- Ablation depends on t_entity.
- Custom sentences with odd one out.
- Triggered Reflection with 'Alternatively' achieves accuracy .684 on gsm8k_adv for Gemma3-4B-ITfinding0.689Highest single-instruction accuracy result in the paper.