quote
active
quote:a-harmful-behavior-that-occurs-once-in-a-million-rollouts-will-rarely-surface-during-pre-deployment-testing-yet-will-almost-inevitably-appear-after-release

A harmful behavior that occurs once in a million rollouts will rarely surface during pre-deployment testing, yet will almost inevitably appear after release.

Motivating statement.

Source paper

extracted_from
Predicting Rare LLM Failures with 30× Fewer Rollouts
Santiago Aranguri

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.