concept
active
concept:geometry-of-featuresGeometry of features
Research thread within About Blank concerning the structure and relational properties of neural network feature representations; covariance pooling tangentially supports this thread.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (2)
concept
- Geometryrelated_toThe actual shapes and spatial relationships of buildings, essential to living structure.
- Second momentsassociated_withStatistical moments capturing pairwise feature co-occurrence patterns; the core insight is that second moments preserve structure that first moments destroy.
Institutes (1)
institute
- About Blankassociated_withResearch group working on AI phenomenology and the Koan Battery.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretable concept representations hypothesized as basic units of computation.
- General principle supported tangentially by covariance pooling work; relates to feature co-occurrence structure.
- Secondary screening signal using persona vector geometry features; full-vector regression reaches Spearman correlations ~0.58-0.61
- Measure of superposition in toy models.
- Features identified in Llama-3.1-8B that compute sums using periods respecting base-10 addition (2, 5, 10) rather than concept-specific periods
- Dual to discrete dictionary features; central frame.
- Hypothesized extension of superposition where features may be higher-dimensional manifolds rather than 1D directions
- A more complex geometric structure used to characterize in-context learning task representations