gemma-3-12b-it

12B Gemma model tested; used for openness linearity visualization (Figure 6)

Neighborhood — ranked by edge-count

concept

Gemma-2-2B-it
related_to
Smallest Gemma model tested, showing near-zero ESR
Gemma-2-9B-it
related_to
Medium Gemma model tested, showing near-zero ESR
Gemma-3-4B-it
related_to
Backbone model used in E3 robustness overlay.
gemma-3-1b-it
related_to
Only model where MDS injections largely failed; excluded from main analyses
gemma-3-27b-it
related_to
27B Gemma model quantized to 4-bit NF4; tested in OCEAN benchmarks

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Gemma-3-4B-it shows three-stage layer trajectory and S(ℓ) peak despite scale differences in dr and ρdfinding0.743
E3 backbone generalization finding for Gemma; validates pattern across diverse architectures
Gemma-2-2B ASR drops from 100% at dims 1–2 to 43.1% at dim 4 and 27.1% at dim 5finding0.728
Small Gemma model shows severe ASR degradation at higher cone dimensions
Gemma 2 27B is unlikely to take on human personas when steered away from Assistant, preferring nonhuman or theatrical portrayalsfinding0.725
Model-specific difference in persona susceptibility
Gemma-2-27B-it deceptive response rate reduced from 100% to 9.36% ± 7.09% after SOO fine-tuningfinding0.725
Primary result showing SOO fine-tuning significantly reduces deception in Gemma-2-27B
Gemma 3 4B wellbeing probe: peak Cohen's d=1.8finding0.722
Weaker cross-family probe; explains weaker introspection in Gemma
Gemma 2: Improving Open Language Models at a Practical Size (Team et al., 2024)concept0.715
Paper describing Gemma 2 model family used in this study
Gemma-2-27B Perspectives accuracy remains 100% after SOO fine-tuningfinding0.714
SOO fine-tuning did not collapse Gemma-2-27B self-other distinction needed for perspective-taking
Gemma 3 4B-IT wellbeing introspection: ρ=0.28, isotonic R²=0.11 (LMM p=1.33×10⁻¹³)finding0.714
Weaker but still significant introspective coupling in Gemma model; consistent with lower probe quality