finding
active
finding:matryoshka-hierarchical-scr-advantages-on-gemma-2-2b-do-not-appear-in-pythia-160mMatryoshka/hierarchical SCR advantages on Gemma-2-2B do not appear in Pythia-160M
Model-scale dependence.
Source paper
extracted_from(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Smaller models' weaker concept representations explain why supervised metrics differ on Pythia-160MsupportsInterpretation of model-scale effects.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Inverse scaling on SCR.
- Central result.
- Experiment 2 result showing large Gemma model supports high-dimensional truth cones
- Per-model steerability comparison from Table 4
- Small Gemma model shows severe ASR degradation at higher cone dimensions
- Establishes potential Llama-family specificity or scale specificity of ESR phenomenon
- Vulnerability profile for Gemma-3-27B showing SP dominance
- Qualitatively different defense profile compared to Llama-3.1-8B