finding
active
finding:relu-hidden-layer-model-n-10-m-5-shifts-from-monosemantic-to-polysemantic-neurons-as-sparsity-increases

ReLU hidden layer model (n=10, m=5) shifts from monosemantic to polysemantic neurons as sparsity increases

Neuron-level phase change.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Papers (1)

paper

Hypotheses (1)

hypothesis

Questions (1)

question

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.