finding
active
finding:scr-at-fixed-intervention-budget-decreases-with-width-for-most-architectures-while-matryoshka-improves-on-gemma-2-2bSCR at fixed intervention budget decreases with width for most architectures while Matryoshka improves on Gemma-2-2B
Inverse scaling on SCR.
Source paper
extracted_from(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Matryoshka's hierarchical structure explains its positive scaling on disentanglement metricsassociated_withsupportsMechanistic interpretation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Model-scale dependence.
- Inverse scaling.
- Inverse SCR scaling persists across intervention sizes for non-hierarchical architecturesfinding0.775Rules out fraction-modified explanation.
- Demonstrates bidirectional causal link: behavior manifold geometry can be recovered by optimizing in representation space.
- Unified interpretation of different adaptation methods via UCCT terms
- Additional synthetic example of pernicious divergence from balanced subspaces
- Prior finding from related work that aligns with ESR being strongest in the largest model tested
- Scaling trends at larger scale.