Open Problems in Mechanistic Interpretability, January 2025

Similar preprints — Semantic Scholar

Cited by (3)

• Steering at the Source: Style Modulation Heads for Robust Persona Control

  Residual-stream activation steering reliably degrades text coherency when steering vectors push models toward out-of-distribution behavior, and this collapse goes undetected by standard benchmarks: MM

• The Platonic Representation Hypothesis

  Neural networks trained on different data modalities, architectures, and objectives are converging toward a shared statistical model of reality — what the paper terms the "platonic representation" — f

• SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agents

  Continual reinforcement learning applied directly to reasoning-optimized base models—rather than starting from instruction-tuned checkpoints—yields a 20-parameter-billion autonomous single-agent, SFR-