finding
active
finding:with-4096-learnable-features-and-450-true-features-300-shared-75-exclusive-per-model-no-density-contrast-between-shared-and-exclusive-features-appears

With 4096 learnable features and 450 true features (300 shared, 75 exclusive per model), no density contrast between shared and exclusive features appears

Toy model in the abundant-capacity regime.

Source paper

extracted_from
Insights on Crosscoder Model Diffing
Siddharth Mishra-Sharma · Trenton Bricken · Jack Lindsey · Adam Jermyn +4

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.