finding
active
finding:gemma-scope-layer-12-latent-frequency-slopes-0-74-16k-and-0-57-32kGemma Scope layer 12 latent frequency slopes -0.74 (16k) and -0.57 (32k)
Implies α≈0.5-0.7.
Source paper
extracted_from(2025) · Michaud, Eric J. · Gorton, Liv · McGrath, Tom
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Uncertain α and β.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Gemma-2-27B attention layer Latent SOO MSE reduced from 11 to 7.67 ± 0.77 after SOO fine-tuningfinding0.802SOO fine-tuning reduced attention layer MSE in Gemma-2-27B though MLP layers showed no significant change
- Training artifact.
- Gemma-3-4B-it shows three-stage layer trajectory and S(ℓ) peak despite scale differences in dr and ρdfinding0.776E3 backbone generalization finding for Gemma; validates pattern across diverse architectures
- Suggests architectural variations influence persona localization pattern
- Vulnerability profile for Gemma-3-27B showing SP dominance
- Shows persona space axes are inherited from pre-training, not solely created by post-training
- High cosine similarity for Gemma3 steering vectors suggests strong linear reflection structure.
- Gemma-2-27B MT-Bench score slightly decreased from 8.81 to 8.40 ± 0.15 after SOO fine-tuningfinding0.756SOO fine-tuning caused a small decrease in Gemma-2-27B general capabilities