claim
active
claim:failure-to-reach-sparsity-reflects-the-basis-not-the-potential-for-sparse-interpretation-no-saliency-scheme-will-do-much-better

Failure to reach sparsity reflects the basis, not the potential for sparse interpretation; no saliency scheme will do much better

Better bases may give sparsity.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Findings (3)

finding

Hypotheses (1)

hypothesis

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.