finding
active
finding:four-best-contrastive-prompt-pairs-outperform-full-16-pair-average-steering-vector-for-type-hint-suppressionFour best contrastive prompt pairs outperform full 16-pair average steering vector for type hint suppression
Optimization result for steering vector construction.
Source paper
extracted_from(2025) · Hua, Tim Tian · Qin, Andrew · Marks, Samuel · Nanda, Neel
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Demonstrates averaging multiple prompt pairs reduces noise; optimal subset selection further improves performance.
- Demonstrates distributed steering is more effective and less accuracy-damaging than concentrated steering.
- Robustness check ruling out that any perturbation would decrease type hint rate due to brittleness.
- Demonstrates steering is not equivalent to prompting with the contrastive prompts.
- Central performance claim of the paper summarizing experimental results
- Validates that steering vectors capture reflection semantics by finding tokens reported in related work.
- Key advantage of preventative over post-hoc steering: lower side-effect cost on general capabilities
- Justifies the choice of response tokens for persona vector extraction in the pipeline