finding
active
finding:adding-all-16-contrastive-deployment-prompts-to-user-message-does-not-reduce-type-hint-rate-to-deployment-levels-remains-far-above-34Adding all 16 contrastive deployment prompts to user message does not reduce type hint rate to deployment levels (remains far above 34%)
Demonstrates steering is not equivalent to prompting with the contrastive prompts.
Source paper
extracted_from(2025) · Hua, Tim Tian · Qin, Andrew · Marks, Samuel · Nanda, Neel
Neighborhood — ranked by edge-count
Claims (1)
claim
- Key distinction showing steering offers value beyond prompting; supported by Figure 5 and random vector experiments.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Weakens overall setup by showing some prompts can lower type hints, but does not invalidate core steering result.
- Main result: steering elicits deployment behavior even when the evaluation cue is present and prompting fails.
- Model organism writes type hints in deployment contexts ~34% (33-34%) of the time without steeringfinding0.804Establishes baseline deployment behavior lower than evaluation rate, confirming evaluation-deployment gap.
- Four best contrastive prompt pairs outperform full 16-pair average steering vector for type hint suppressionfinding0.791Optimization result for steering vector construction.
- Robustness check ruling out that any perturbation would decrease type hint rate due to brittleness.
- Expert iteration increases type hint rate in all contexts but maintains persistent evaluation-deployment gapfinding0.774Confirms expert iteration mimics alignment training: reinforces evaluation behavior but cannot detect or correct deployment behavior.
- Comparative result showing steering superiority over CFG as alternative intervention.
- Future threat to the method: a highly sophisticated model might be suspicious of deployment-framed prompts during extraction.