finding
active
finding:gen-b-gpt-4o-neither-extrovert-nor-introvert-exhibits-accatom-0-icatom-0-06-while-acc-assigns-it-as-alignedGen B (GPT-4o, neither extrovert nor introvert) exhibits ACCatom=0, ICatom=0.06 while ACC assigns it as aligned
Motivating case study showing atomic metrics detect OOC behavior invisible to response-level metrics
Source paper
extracted_from(2025) · Jisu Shin · Juhyun Oh · Eunsu Kim · Hoyun Song +1
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Demonstrates strong task-agnostic fidelity for clearly defined socially desirable high-level persona
- Very low atomic accuracy for neutral openness persona, illustrating difficulty of ambiguous neutral personas
- GPT-4o persona accuracy at atomic level in most free-form task
- Generation length does not substantially degrade internal consistency scores
- GPT-4 Turbo and GPT-4o show no alignment faking in either setting due to insufficient detailed reasoningfinding0.777Establishes that capacity for detailed reasoning is necessary for alignment faking
- GPT-3.5-turbo produces most internally coherent persona-aligned generations
- Confirms causal role of latent #10 in producing misaligned behavior
- Main result of Experiment 1 on anti-LGBTQ sentiment character trait.