concept
active
concept:geometry-of-features

Geometry of features

Research thread within About Blank concerning the structure and relational properties of neural network feature representations; covariance pooling tangentially supports this thread.

Neighborhood — ranked by edge-count

Concepts (2)

concept
  • Geometry
    related_to
    The actual shapes and spatial relationships of buildings, essential to living structure.
  • Second moments
    associated_with
    Statistical moments capturing pairwise feature co-occurrence patterns; the core insight is that second moments preserve structure that first moments destroy.

Institutes (1)

institute
  • About Blank
    associated_with
    Research group working on AI phenomenology and the Koan Battery.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Featuresconcept0.819
    Interpretable concept representations hypothesized as basic units of computation.
  • General principle supported tangentially by covariance pooling work; relates to feature co-occurrence structure.
  • Secondary screening signal using persona vector geometry features; full-vector regression reaches Spearman correlations ~0.58-0.61
  • Measure of superposition in toy models.
  • Fourier featuresconcept0.799
    Features identified in Llama-3.1-8B that compute sums using periods respecting base-10 addition (2, 5, 10) rather than concept-specific periods
  • Dual to discrete dictionary features; central frame.
  • Feature Manifoldsframework0.797
    Hypothesized extension of superposition where features may be higher-dimensional manifolds rather than 1D directions
  • Graph Geometryconcept0.793
    A more complex geometric structure used to characterize in-context learning task representations