question
active
question:what-is-the-optimal-block-dimension-and-what-is-the-typical-dimensionality-of-a-conceptWhat is the optimal block dimension and what is the typical dimensionality of a concept?
Motivates stable-rank study.
Source paper
extracted_from(2026) · Thomas Fel · Matthew Kowal · Mozes Jacobs · Dron Hazra +21
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Concept dimensionality.
Claims (1)
claim
- Interpretation of stable rank.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Featurizer-specific optima.
- Fraction of a dimension given to a feature.
- Measure of superposition in toy models.
- Motivates the RN hypothesis by pointing to the unknown relational structure within high-dimensional representation vectors.
- Concepts are the building blocks of software systems, objective features of a system’s design.claim0.740Asserts that concepts are not just mental but concrete design elements.
- Proxy for number of concepts needed to explain activations.
- Feature presence depends on concept frequency in training data, with a threshold scaling inversely with alive features.
- Jackson identifies this as a central unresolved research question despite widespread recognition of concept importance