finding
active
finding:general-sycophancy-is-already-high-in-sft-and-only-slightly-modulated-by-dpo-reward-shaping-does-not-reduce-it-below-sft-levels

General sycophancy is already high in SFT and only slightly modulated by DPO; reward shaping does not reduce it below SFT levels

Fig. 12.

Source paper

extracted_from
Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signal
(2026) · Leon Bergen · Usha Bhalla · Sidharth Baskaran · Max Loeffler +13

Neighborhood — ranked by edge-count