method
active
method:mean-subtracted-query-key-cosine-similarity-analysisMean-subtracted query/key cosine similarity analysis
Measures QK geometry between country queries and city keys.
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- QK geometry anti-alignment.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Geometric analysis tracking how persona vector directions evolve across transformer layers to identify the transition layer
- Used to quantify the semantic clustering of adjective-set embeddings across model families and conditions
- Used to measure alignment between DIM direction and cone basis vectors to assess overlap
- Detects tiling in real SAEs.
- Cosine similarity between feature activations restricted to tokens where one of the features fires; used to identify feature splitting relationships
- Measures alignment of learned components with target columns.
- Method to discover new reflection-inducing instructions by ranking candidate tokens by cosine similarity to steering vectors.
- Quantifies event alignment of codes.