finding
active
finding:preference-steering-effective-only-in-mid-layer-range-though-correlations-hold-across-layersPreference steering effective only in mid-layer range though correlations hold across layers
Suggests mid-layer reading circuitry.
Source paper
extracted_from(2026) · Nicholas Sofroniew · Isaac Kauvar · William Saunders · Runjin Chen +12
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Practical finding for optimizing steering setup.
- Suggests localization.
- Self-repair effect.
- Contrast with probe steering.
- Demonstrates distributed steering is more effective and less accuracy-damaging than concentrated steering.
- Steering effect size across 35 emotion vectors correlates with probe-preference correlation at r=0.85finding0.798Emotions correlating with preference causally drive it.
- Features not merely relayed via residual connections.
- Demonstrates averaging multiple prompt pairs reduces noise; optimal subset selection further improves performance.