question
active
question:can-we-estimate-the-feature-importance-curve-or-feature-sparsity-curve-of-real-models

Can we estimate the feature importance curve or feature sparsity curve of real models?

Open question.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Papers (1)

paper

Concepts (1)

concept
  • Property that features activate on only a small fraction of inputs; enables compressed sensing and is what allows superposition to work

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.