claim
active
claim:model-diff-amplification-is-one-part-of-a-larger-evaluation-pipeline-e-g-red-teamingModel diff amplification is one part of a larger evaluation pipeline, e.g. red-teaming
Positioning.
Source paper
extracted_fromThomas McGrath
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Scope limitation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core method: sample from logits_after + α(logits_after − logits_before) to surface rare behaviors.
- Conclusion.
- Stated generalization, untested here.
- Core motivation.
- Monitoring use case.
- Implication of PRH for AI fairness and bias
- Prior method extrapolating beyond the original model in logit space to surface rare behaviors.
- Unsupervised approach may be sufficient for early detection of misaligned persona latents without knowing the misaligned behavior in advance