ACCatom (Atomic-level Accuracy)

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• ICatom (Atomic-level Internal Consistency)method0.803
  Measures consistency of persona expression within a single generated response via inverse normalized standard deviation
• ACC (Response-level Accuracy)method0.771
  Prior metric assigning a single accuracy score to an entire response; baseline for comparison
• RCatom (Atomic-level Retest Consistency)method0.735
  Measures reproducibility of persona alignment across repeated generations using Earth Mover's Distance
• Full-Accuracy (FA)method0.725
  Proportion of characters (out of 26) for which all five Big Five dimensions are predicted correctly
• Atomic Unit (persona evaluation)concept0.721
  Defined as the smallest textual segment conveying persona-relevant characteristics; operationalized as a sentence
• Pearson r = 0.91 between ACC and ACCatom across all modelsfinding0.719
  High correlation shows ACCatom measures similar underlying construct to ACC but with finer granularity
• GPT-4o LLM-based Atomic Scoringmethod0.716
  GPT-4o (temperature=0) used to assign personality scores [1-5] to each atomic sentence
• Accuracy Criterionconcept0.715
  Criterion requiring that model's description of internal state be accurate, distinguishing genuine introspection from confabulation.