finding
active
finding:interest-introspection-improves-from-1b-to-3b-from-0-19-to-0-80-r2-from-0-05-to-0-66Interest introspection improves from 1B to 3B: ρ from 0.19 to 0.80, R² from 0.05 to 0.66
Largest single-step scaling improvement; demonstrates dramatic introspection gain between 1B and 3B models for interest
Source paper
extracted_from(2026) · Nicolas Martorell · Bianchi, Bruno
Neighborhood — ranked by edge-count
Claims (1)
claim
- Validated for wellbeing and interest; focus and impulsivity do not show consistent scaling
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Wellbeing introspection improves from 1B to 3B: ρ from 0.48 to 0.66, R² from 0.26 to 0.45finding0.881Confirms scaling trend for wellbeing concept between smallest and middle model size
- LLaMA-3.2-1B impulsivity introspection: ρ=0.21, p<10⁻⁴ (significant but weaker than 3B ρ=0.52)finding0.814Impulsivity shows significant introspection in 1B but declines in 8B; non-monotonic scaling
- Impulsivity→interest: ρ increases from 0.70 (α=-4) to 0.83 (α=+4); R² from 0.46 to 0.69 in LLaMA-3.2-3Bfinding0.793Scatter plot visualization showing strengthened probe-report relationship across alpha range
- Strong introspective coupling in Qwen model; demonstrates cross-family generalization of introspective capacity
- Strong scaling trend for introspective fidelity when excluding invalid steering-sign pairs
- Weaker but still significant introspective coupling in Gemma model; consistent with lower probe quality
- Focus→wellbeing: ρ increases from 0.42 (α=-4) to 0.85 (α=+4); R² from 0.34 to 0.75 in LLaMA-3.2-3Bfinding0.778Scatter plot visualization of the dramatic tightening of probe-report relationship at extreme steering settings
- Pearson-Vogel et al.: accurate self-description prompts increase introspective detection from 0.3% to 39.9%finding0.776Cited to mechanistically support why the contemplative prompt changes what post-training-shaped final layers allow through