concept
active
concept:scale-dependent-esrScale-Dependent ESR
The observed pattern that ESR appears predominantly in the largest model tested, suggesting scale-dependence
Neighborhood — ranked by edge-count
Concepts (1)
concept
- The central phenomenon introduced by this paper: inference-time recovery from irrelevant activation steering in LLMs
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Central unresolved question about the mechanism behind ESR's apparent size-dependence
- We cannot isolate whether ESR reflects scale, architecture, or training procedures in Llama-3.3-70Bclaim0.751Epistemic limitation claim acknowledging confounds in the cross-model comparison
- Primary metric: percentage of responses containing multiple attempts that successfully improve on the first attempt
- Form of ESR occurring without explicit verbal self-interruption markers, not captured by current metrics
- Central tenet: biological computation is fundamentally non-modular; molecular, cellular, and population scales bidirectionally co-determine each other without privileged level.
- The form of ESR focused on in this paper, measured by verbal self-interruption phrases as segment boundaries
- Meta-problem: alignment techniques may collapse under rapid self-improvement or extreme complexity
- Three-step protocol: (1) object-level prompting, (2) SAE-latent steering, (3) judge model scoring of attempts