finding
active
finding:wellbeing-probe-score-drift-across-turns-significant-at-all-three-llama-scales-slopes-0-006-0-005-0-013-for-1b-3b-8b-all-p-10-10-drift-magnitude-increases-with-scaleWellbeing probe-score drift across turns significant at all three LLaMA scales (slopes=0.006, 0.005, 0.013 for 1B, 3B, 8B; all p<10⁻¹⁰); drift magnitude increases with scale
Internal-state drift generalizes across scales; normalized drift also increases significantly with log(model size)
Source paper
extracted_from(2026) · Nicolas Martorell · Bianchi, Bruno
Neighborhood — ranked by edge-count
Concepts (1)
concept
- Persona driftextendsBehavioural drift in multi-turn LLM interaction; documented in prior work for persona, identity, and instruction-following
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interest probe score drifts positively across turns: LMM slope=0.005, p=4.12×10⁻¹⁴ in LLaMA-3.2-3Bfinding0.859Demonstrates genuine internal-state dynamics in LLMs during multi-turn conversation
- Wellbeing probe drift is positive in Gemma (ρ=0.34 pooled turn-correlation) and Qwen (ρ=0.24); both p<10⁻⁵finding0.859Normalized probe-score drift across turns generalizes beyond LLaMA family
- Unlike probe drift, report drift magnitude does not follow a clean scaling law; size-slope is negative
- LLaMA-3.1-8B-Instruct wellbeing introspection: ρ=0.93, isotonic R²=0.90 (LMM probe slope p<10⁻¹⁰)finding0.837Near-ceiling introspective performance for wellbeing concept in 8B model; nearly deterministic probe-report relationship
- Quantifies per-concept effect size of same-concept steering on self-report
- Probe validation result confirming wellbeing direction captures meaningful structure
- Demonstrates introspection is present from the first conversation turn without needing multi-turn context
- Second-strongest pooled introspective coupling in primary model