finding
active
finding:colors-organize-along-a-paraboloid-with-circular-hue-and-lightness-dimensions-in-llama3-1-8bColors organize along a paraboloid with circular hue and lightness dimensions in Llama3.1-8B
A novel manifold geometry.
Source paper
extracted_from(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Manifold structure is present in representations and causally influences downstream behaviorsupportsInterpretation of steering results.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Evidence that manifolds exist in LLM representations.
- Scale-dependent alignment result demonstrating how more abstract truth representations emerge with scale
- Empirical observation establishing that Llama's internal representations for days-of-week have circular geometric structure.
- Demonstrates that small models represent surface features rather than abstract truth
- The representation geometry finding that motivates the question about whether computation mirrors it
- Key empirical result showing that optimizing for behavioral outputs and fitting representation geometry produce the same path in activation space.
- One of four LLMs selected for representation analysis; embedding dimension D=4096; used as demonstration model in scatter plots.