claim
active
claim:seemingly-smooth-loss-decreases-in-larger-models-are-composed-of-many-small-feature-jumps

Seemingly smooth loss decreases in larger models are composed of many small feature jumps

Suspicion from energy level jumps.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.