finding
active
finding:wellbeing-introspection-improves-from-1b-to-3b-from-0-48-to-0-66-r2-from-0-26-to-0-45Wellbeing introspection improves from 1B to 3B: ρ from 0.48 to 0.66, R² from 0.26 to 0.45
Confirms scaling trend for wellbeing concept between smallest and middle model size
Source paper
extracted_from(2026) · Nicolas Martorell · Bianchi, Bruno
Neighborhood — ranked by edge-count
Claims (1)
claim
- Validated for wellbeing and interest; focus and impulsivity do not show consistent scaling
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interest introspection improves from 1B to 3B: ρ from 0.19 to 0.80, R² from 0.05 to 0.66finding0.881Largest single-step scaling improvement; demonstrates dramatic introspection gain between 1B and 3B models for interest
- Strong introspective coupling in Qwen model; demonstrates cross-family generalization of introspective capacity
- Weaker but still significant introspective coupling in Gemma model; consistent with lower probe quality
- LLaMA-3.1-8B-Instruct wellbeing introspection: ρ=0.93, isotonic R²=0.90 (LMM probe slope p<10⁻¹⁰)finding0.827Near-ceiling introspective performance for wellbeing concept in 8B model; nearly deterministic probe-report relationship
- Demonstrates introspection is present from the first conversation turn without needing multi-turn context
- LLaMA-3.2-1B impulsivity introspection: ρ=0.21, p<10⁻⁴ (significant but weaker than 3B ρ=0.52)finding0.789Impulsivity shows significant introspection in 1B but declines in 8B; non-monotonic scaling
- Second-strongest pooled introspective coupling in primary model
- Focus→wellbeing: ρ increases from 0.42 (α=-4) to 0.85 (α=+4); R² from 0.34 to 0.75 in LLaMA-3.2-3Bfinding0.779Scatter plot visualization of the dramatic tightening of probe-report relationship at extreme steering settings