method
active
method:kendall-s-tau-rank-correlationKendall's tau rank correlation
Used to measure alignment between human judgments and LLM-based scores in validation
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Statistical method used by Yodan Rose to measure agreement between different people's neighborhood diagnoses.
- Statistical measure used to evaluate correlation between diversity metrics and diversity parameter / human judgments
- Used to compare RDMs in RSA computations; noted to have sensitivity issues with differing relative extrema in embedding layers.
- Pearson correlation of feature activations across 40M tokens used to measure feature similarity and universality across models
- Validates robustness of alignment metric choice
- Measures emotion feature persistence as correlation between z-scored activation at token 0 and token 100 across all eligible target model tokens
- Kendall's τ = 0.76 (p<.001) for Conscientiousness dimension LLM scoring vs human judgmentfinding0.687Validates GPT-4o scoring reliability for Conscientiousness personality dimension
- Shows base64 feature is polysemantic at neuron level but monosemantic as learned feature