claim
active
claim:individual-features-offer-only-a-narrow-view-of-a-concept-only-the-group-of-features-tiling-a-manifold-carries-geometric-meaningIndividual features offer only a narrow view of a concept; only the group of features tiling a manifold carries geometric meaning
Implication for interpretability.
Source paper
extracted_from(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Top SAE features on the years manifold show localized smooth tuning curves with overlapping supportsupportsReminiscent of population coding.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Future-work perspective.
- Core future-work framing.
- Features may not be strictly one-dimensional objects; higher-dimensional feature manifolds may exist in model representationshypothesis0.823Extension of superposition hypothesis to account for continuous families of features
- General principle supported tangentially by covariance pooling work; relates to feature co-occurrence structure.
- Discrete features and feature manifolds are dual descriptions of the same underlying objectclaim0.805Duality.
- Proposes that nonlinear geometric structure is superior to linear feature spaces for capturing semantic content.
- Hypothesized extension of superposition where features may be higher-dimensional manifolds rather than 1D directions
- Explanation of brittle steering.