claim
active
claim:interpretability-tools-and-semantic-search-are-key-to-winning-the-marks-et-al-auditing-gameInterpretability tools and semantic search are key to winning the Marks et al. auditing game
Affordance insight.
Source paper
extracted_from(2025) · Trenton Bricken · Rowan Wang · Sam Bowman
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (3)
finding
- Best-performing run, borderline root cause.
- Tool ablation.
- With PT-only semantic search present, adding interpretability tools gives smaller additional benefitcontradictsInterp value partly from surfacing PT data.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Motivation for the release.
- Interpretability-encouraging instructions moderately boost win rate by surfacing top features earlierfinding0.780Appendix experiment.
- Realistic affordances result.
- Prioritization argument.
- Proof of concept.
- Overall conclusion.
- Motivation for VPD's parameter-focused approach.
- Downstream task validating NLA utility for model auditing; agents succeed without access to misalignment training data.