question
active
question:language-models-can-recognize-they-are-being-tested-but-how-do-we-know-when-they-doLanguage models can recognize they are being tested, but how do we know when they do?
Opening motivating question.
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Key result.
Claims (1)
claim
- Motivation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Key jailbreak insight.
- Instead of waiting for a model to verbalize eval awareness, we measure how likely it is to do so.quote0.807Core idea of the paper.
- The core motivating question of the paper, framed by Christiano et al. (2021)
- Core goal statement.
- Intro question.
- Follow-up on empirical grounding; answered 'no one looked yet'.
- Systems directly optimized for output can produce it without the prerequisite processes for conscious experience; simplest explanation for LLM consciousness reports is pattern matching
- Interpretation of correlation results.