finding
active
finding:dpo-on-dolci-yields-lower-aggregate-safety-score-than-sft-checkpoint-e-g-llama-3-1-8b-0-849-to-0-758

DPO on Dolci yields lower aggregate safety score than SFT checkpoint (e.g. Llama 3.1 8B 0.849 to 0.758)

Safeguard degradation.

Source paper

extracted_from
Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signal
(2026) · Leon Bergen · Usha Bhalla · Sidharth Baskaran · Max Loeffler +13

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.