finding
active
finding:spearman-s-rank-correlation-among-different-alignment-metrics-cka-svcca-mutual-k-nn-cknna-over-78-vision-models-is-high-across-variants-with-all-p-values-below-2-24-10-105Spearman's rank correlation among different alignment metrics (CKA, SVCCA, Mutual k-NN, CKNNA) over 78 vision models is high across variants, with all p-values below 2.24×10^-105
Validates robustness of alignment metric choice
Source paper
extracted_from(2024) · Minyoung Huh · Brian Cheung · Tongzhou Wang · Phillip Isola
Neighborhood — ranked by edge-count
Methods (1)
method
- Primary alignment metric used in experiments; measures mean intersection of k-nearest neighbor sets between two kernels
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Post-training inter-model convergence in trait preferences demonstrating persona convergence
- Used to compare RDMs in RSA computations; noted to have sensitivity issues with differing relative extrema in embedding layers.
- Vector geometry features provide moderate secondary signal beyond elicitation-only screen
- Cross-architecture geometric invariance of Big Five steering vectors
- Explains why mutual k-NN was chosen over CKA as primary metric
- Cross-architecture universality of SP rankings
- Statistical measure used to evaluate correlation between diversity metrics and diversity parameter / human judgments
- Automated interpretability analysis of activations confirms features are more interpretable than neurons