finding
active
finding:in-the-residual-stream-a-country-and-its-own-cities-have-positive-cosine-similarity-mean-0-17In the residual stream a country and its own cities have positive cosine similarity (mean +0.17)
Head flips sign via W_Q and W_K.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Supported by geometry and 98% result but not a full account.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Mechanistic evidence that network actively attenuates injected perturbations, explaining late-layer introspection failure
- Appendix E replication of DIM alignment finding in Qwen model
- Country query vs own-city key cosine similarity mean −0.47, versus +0.01 for other citiesfinding0.795QK geometry anti-alignment.
- Evidence for twisting.
- Confirms that head importance is driven by direction, not just output norm magnitude
- Even basic methods become unreliable.
- Many-shot vector geometry.
- Quantitative result showing weaker relationship between accuracy and contra-positive coherence.