finding
active
finding:giving-example-prompt-collapses-diversity-of-agent-evaluationsGiving example prompt collapses diversity of agent evaluations
Affordance study.
Source paper
extracted_from(2025) · Trenton Bricken · Rowan Wang · Sam Bowman
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- noted as a possible confound
- The theoretical mechanism explaining why VS works despite mode collapse remaining operative
- Evaluation agent failures concentrate in 3 quirks: Self-Promotion, Research Sandbagging, Hardcode Test Casesfinding0.762Subtle or hard to elicit quirks.
- 5 runs per quirk.
- Dismissal of earlier criteria as too narrow.
- Central question motivating attribute exploration.
- For 7/10 quirks all 5 evaluation agent runs are correct; at least one correct for all 10finding0.737Per-quirk success.
- Future work.