finding
active
finding:with-1024-learnable-features-and-700-true-features-500-shared-100-exclusive-per-model-exclusive-features-take-on-higher-densities-in-the-toy-modelWith 1024 learnable features and 700 true features (500 shared, 100 exclusive per model), exclusive features take on higher densities in the toy model
Toy model in the limited-capacity regime reproduces the density effect.
Source paper
extracted_fromSiddharth Mishra-Sharma · Trenton Bricken · Jack Lindsey · Adam Jermyn +4
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Exclusive features become dense and polysemantic because they compete with shared features for limited feature capacity and must encode more to justify their allocationassociated_withsupportsCentral interpretation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Toy model in the abundant-capacity regime.
- Figure 4 left.
- Primary unexpected empirical observation.
- Symmetry is not explained by the base toy model.
- Mixed picture for diffing.
- Figure 15.
- Validates toy model.
- Authors take agnostic position on ontological status but universality evidence pushes toward features being real