claim
active
claim:an-attention-head-can-be-polysemantic-without-superposition-because-its-output-is-high-rank-unlike-an-mlp-neuron

An attention head can be polysemantic without superposition because its output is high-rank, unlike an MLP neuron

Theoretical point.

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.