claim
active
claim:moe-models-should-have-less-superposition-because-they-eat-the-gap-between-neuron-and-feature-sparsity

MoE models should have less superposition because they eat the gap between neuron and feature sparsity

Strategic Approach 1.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Papers (1)

paper

Claims (1)

claim

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.