finding
active
finding:disabling-the-copyright-refusal-feature-degrades-coherence-and-the-model-mostly-hallucinates-the-copyrighted-textDisabling the copyright refusal feature degrades coherence and the model mostly hallucinates the copyrighted text.
§3.3.2.
Source paper
extracted_from(2026) · Thomas Jiralerspong · Trenton Bricken
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Disabling yields hallucination.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A priori unknown behavior discovered.
- Figure 20.
- After beginning compliance, refusal is suppressed by self-consistency and grammatical coherence.claim0.774Jailbreak persistence.
- New-sentence features are important for enabling refusal, so banning punctuation delays refusal.hypothesis0.760Predicts no-punctuation instruction makes jailbreak more effective.
- Predictive hypothesis driving the investigation in Section 3.3; supported by experimental evidence.
- Causal effect: feature induces perception of bugs.
- Refusal is not a single linear classifier.
- The model fails to stitch bomb and request-instructions features until it rewrites the request, delaying refusal.hypothesis0.753Validated by activating a make-a-bomb feature on BOMB token.