concept
active
concept:feature-dimensionalityFeature dimensionality
Fraction of a dimension given to a feature.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionintroducesmentions
Concepts (1)
concept
- Tegum productsassociated_withPolytope construction explaining orthogonal factors in feature geometry.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Measure of superposition in toy models.
- Dual to discrete dictionary features; central frame.
- Property that features activate on only a small fraction of inputs; enables compressed sensing and is what allows superposition to work
- Property of features that form consistently across different models trained on the same or similar data, suggesting features are real representational units
- Proxy for number of concepts needed to explain activations.
- Decomposability, linearity, superposition, basis alignment.
- Measures features learned.
- Research thread within About Blank concerning the structure and relational properties of neural network feature representations; covariance pooling tangentially supports this thread.