finding
active
finding:gpt-4o-overall-accatom-0-52-on-social-media-post-taskGPT-4o overall ACCatom = 0.52 on Social Media Post task
GPT-4o persona accuracy at atomic level in most free-form task
Source paper
extracted_from(2025) · Jisu Shin · Juhyun Oh · Eunsu Kim · Hoyun Song +1
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Very low atomic accuracy for neutral openness persona, illustrating difficulty of ambiguous neutral personas
- Demonstrates strong task-agnostic fidelity for clearly defined socially desirable high-level persona
- Motivating case study showing atomic metrics detect OOC behavior invisible to response-level metrics
- Provides early warning evidence: latent activation detects misalignment not yet visible in behavioral evaluation
- Key empirical result from Betley et al. 2025 that initiated persona vector research
- GPT-4o (temperature=0) used to assign personality scores [1-5] to each atomic sentence
- GPT-4o insecure S=1.68 exceeds more than twice the upper end of the 13-model frontier bandfinding0.764Most extreme susceptibility spike, placing GPT-4o insecure well outside normal model distribution
- GPT-4o-mini most consistent in reproducing persona-aligned atomic distributions across repeated generations