semantic structure

The meaningful organization of concepts in a model's representation space, claimed to be better captured by manifolds than by SAEs.

Neighborhood — ranked by edge-count

claim

SAE features tend to shatter manifolds into many small and apparently-unrelated pieces, obscuring the overarching semantic structure.
cites
Core critique of sparse autoencoders: they break the geometric structure of representations, making it harder to see the big picture.
Manifold-level descriptions recover overarching semantic structure that SAE features miss.
cites
Positive claim that geometric descriptions retain the conceptual coherence lost in atomized feature decompositions.

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

data structuresconcept0.805
Conventional programming constructs like variables, arrays; claimed unnecessary for Elephant programs.
semantic valueconcept0.799
Meaning that arises from relations within the graphical system, not inherent in elements.
Structure in computationconcept0.780
The actual computational operations a model performs, which the paper argues need not mirror representational structure
Structure in representationsconcept0.778
The central question of whether representational geometry implies corresponding computational structure
Semantic Denotationconcept0.773
Central mechanism in denotational design: precise mathematical meaning assigned to types and expressions, independent of implementation.
Semantic relations through graphical formconcept0.773
Central claim that meaning emerges from spatial positioning and relational organization of elements on a page.
Deep Structureconcept0.768
What is the structure of this domain?question0.767
Question about the inner structure of the plenum, leading to the answer that it is pure unity without structure.