method
active
method:verbalization-monitorVerbalization monitor
Baseline sampling k rollouts and scoring the fraction judged to verbalize eval awareness.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- When the model explicitly mentions being tested in its chain-of-thought reasoning; distinguished from behavioral evaluation awareness.
Methods (1)
method
- Rubric taken from Aranguri and Bloom (2026), applied with GPT 5.4 as judge.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Component of NLA that maps activations to text descriptions; initialized as copy of target LLM with supervised warm-start on summarization task.
- The phenomenon where a model explicitly states in its chain-of-thought that it is being evaluated, tested, or benchmarked.
- Training-free monitor that token-forces an eval-aware sentence and computes its probability at each CoT sentence boundary.
- The paper's proposed training-free prompting strategy that prompts the model to verbalize a probability distribution over a set of responses rather than generating a single response
- Visualizes feature interference matrix.
- The logit monitor outperforms LLM-judge verbalization monitoring using 10× to 100× fewer rolloutsclaim0.722Central claim.
- Synchronization construct encapsulating shared data and protected access routines.