finding
active
finding:in-qwen-2-5-9b-only-v1-has-meaningful-cosine-similarity-to-dim-direction-all-additional-basis-vectors-have-cosine-similarities-1e-9In Qwen-2.5-9B, only v1 has meaningful cosine similarity to DIM direction; all additional basis vectors have cosine similarities ~1e-9
Appendix E replication of DIM alignment finding in Qwen model
Source paper
extracted_from(2025) · Kevin Shengyang Yu · Vaidehi Bulusu · Oscar Yasunaga · Lau, Clayton +4
Neighborhood — ranked by edge-count
Claims (1)
claim
- Interpretation of Experiment 4 cosine similarity results
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Experiment 4 result showing DIM captures only one facet of the multi-dimensional truth subspace
- Pairwise cosine similarities between Description, Narration, and Dialogue evil vectors are all below 0.5finding0.809Shows different elicitation strategies recover qualitatively distinct persona directions
- Distinct from internal emotion.
- Core result of Experiment 3: cross-model semantic convergence under self-referential processing
- Geometric measure used to track persona vector drift and stability across checkpoints
- Many-shot vector geometry.
- In the residual stream a country and its own cities have positive cosine similarity (mean +0.17)finding0.796Head flips sign via W_Q and W_K.
- Supporting finding for the trait refusal alignment framework