finding
active
finding:model-exclusive-features-have-feature-densities-about-an-order-of-magnitude-higher-than-shared-features-in-base-vs-helpful-only-claude-3-sonnet-like-diffs

Model-exclusive features have feature densities about an order of magnitude higher than shared features in base vs helpful-only Claude 3 Sonnet-like diffs

Primary unexpected empirical observation.

Source paper

extracted_from
Insights on Crosscoder Model Diffing
Siddharth Mishra-Sharma · Trenton Bricken · Jack Lindsey · Adam Jermyn +4

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.