concept
active
concept:mid-residual-layer-injectionMid-Residual Layer Injection
Design choice to inject CVs at the middle residual layer where stylistic effects are strongest
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core activation intervention: add scaled vector to residual stream at layer l during completion
- Technique of adding control vectors to model hidden states at mid-residual layers without weight updates
- Design choice claim based on prior work and preliminary results
- The middle layer residual stream features are causally implicated in multi-step reasoning.claim0.733Features for Kobe Bryant, California, Lakers participate in computing the capital answer.
- Empirical observation that steering efficiency peaks at middle transformer layers, consistent with emotion representation literature
- Mechanistic account explaining why late-layer introspection fails, combining two independent explanatory factors
- Architectural choice where the original input is projected and re-injected at each recurrence, studied for its effect on fixed-point convergence
- Technique to localize causally implicated hidden states by swapping residual stream activations between a true and false input and measuring downstream log-probability changes