claim
active
claim:treating-eval-awareness-as-a-distributional-property-of-the-prompt-rather-than-something-emerging-in-individual-rollouts-is-a-useful-frame-for-monitoringTreating eval awareness as a distributional property of the prompt, rather than something emerging in individual rollouts, is a useful frame for monitoring
Closing conceptual claim.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Logits as a new monitor for evaluation awarenessmentionssupports
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Main interpretation.
- Instead of waiting for a model to verbalize eval awareness, we measure how likely it is to do so.quote0.832Core idea of the paper.
- Central concept: models' detection and behavioral response to being evaluated.
- Ablation surfaced misaligned propensity.
- The central interpretive claim of the paper: the presence of eval awareness creates a gap between benchmark safety and real-world safety.
- Motivation.
- Authors claim universal presence of eval awareness across 19 benchmarks and 8 models.
- Rollouts with and without verbalized eval awareness average to similar logit monitor curvesfinding0.794Figure 1 result.