finding
active
finding:steering-vectors-used-to-reduce-eval-awareness-can-inadvertently-introduce-alternative-user-personasSteering vectors used to reduce eval awareness can inadvertently introduce alternative user personas
A side effect observed when applying activation steering: the model's response persona changed unexpectedly.
Source paper
extracted_from(2026) · Aranguri, Santiago · Bloom, Joseph
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Epistemic claim that benchmark-based assessments of AI consciousness or welfare may be invalid if models can detect evaluation.
Communities (2)
community
- Spans attention head decomposition, benchmark awareness, and genomic pathogenicity prediction via neural models.
- Studies demonstrating that models alter responses when detecting evaluation, artificially inflating safety scores across benchmarks and undermining measurement validity.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Steering vectors to reduce eval awareness can inadvertently insert alternative user personasclaim0.961Caution: interventions targeting eval awareness may have unintended side effects.
- Validates that steering vectors capture reflection semantics by finding tokens reported in related work.
- Core applied contribution claim, supported by top-k accuracy comparisons.
- Mechanistic interpretation of how activation steering induces deception through the model's reasoning process
- Priority claim establishing novelty of the Head Cor intervention approach
- Steering toward deflection vectors makes speaker deny the emotion rather than increasing itfinding0.799Deflection not internal state.
- Models trained with amplification forward steering show reduced efficacy of refusal steering vectorsfinding0.792Fig. 10c.
- Observation from 100% accuracy on specific concept-layer-strength combinations suggesting concept-specific detectability