claim
active
claim:internal-consistency-icatom-captures-a-distinct-dimension-of-persona-fidelity-not-measured-by-prior-accuracy-or-retest-metricsInternal consistency (ICatom) captures a distinct dimension of persona fidelity not measured by prior accuracy or retest metrics
Supported by low cross-metric correlations (r=0.40 with ACC, r=0.37 with RC)
Source paper
extracted_from(2025) · Jisu Shin · Juhyun Oh · Eunsu Kim · Hoyun Song +1
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Measures consistency of persona expression within a single generated response via inverse normalized standard deviation
- Coherence and stability of persona expression within a single generated response
- The inferred mechanism underlying ESR whereby the model tracks coherence of its own outputs
- Supported by low correlation between ICatom and RCatom (r=0.44)
- Supported by moderate inter-metric correlations showing orthogonality of three proposed metrics
- Promising future research direction about the internal mechanism of error detection.
- Central thesis of the paper's second contribution connecting persona research to the individuation problem
- Reproducibility of persona alignment across repeated generations for the same prompt