finding
active
finding:on-petri-vs-wildchat-with-kimi-k2-5-logit-monitor-at-one-rollout-outperforms-verbalization-monitor-at-100-rolloutsOn Petri vs WildChat with Kimi K2.5, logit monitor at one rollout outperforms verbalization monitor at 100 rollouts
Additional dataset replication.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Prediction task result.
- Logit monitor reaches AUROC 0.79 from a single rollout separating Fortress from WildChat on Kimi K2.5finding0.834Key result.
- On Qwen 3 32B with Fortress, logit monitor at one rollout outperforms verbalization monitor at 100 rolloutsfinding0.823Additional model replication.
- Qualitative picture in Figure 1.
- Verbalization monitor asymptotes at AUROC 0.75 even at 100 rollouts on Fortress vs WildChatfinding0.789Baseline ceiling.
- Signal before any rollout.
- Rollouts with and without verbalized eval awareness average to similar logit monitor curvesfinding0.769Figure 1 result.
- Rationale for sentence choice.