question
active
question:can-we-estimate-the-feature-importance-curve-or-feature-sparsity-curve-of-real-modelsCan we estimate the feature importance curve or feature sparsity curve of real models?
Open question.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionmentions
Concepts (1)
concept
- Feature SparsitycitesProperty that features activate on only a small fraction of inputs; enables compressed sensing and is what allows superposition to work
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Baseline.
- Motivates multi-metric evaluation.
- Open question for safety applications.
- Cited as enabling precise behavioral control through SAE features, extending the same methodological line
- Datapoint features form only if there is a repeated datapoint in training and sparsity regularization is appliedhypothesis0.752Two necessary conditions.
- can we use the feature basis to detect when fine-tuning a model increases the likelihood of undesirable behaviors?question0.751Question about practical safety application of feature monitoring.
- Central claim motivating the product.
- General principle supported tangentially by covariance pooling work; relates to feature co-occurrence structure.