finding
active
finding:pca-of-llama3-1-8b-layer-19-activations-shows-smooth-curved-geometries-for-age-temperature-day-color-years-and-others

PCA of Llama3.1-8B layer-19 activations shows smooth curved geometries for age, temperature, day, color, years, and others

Evidence that manifolds exist in LLM representations.

Source paper

extracted_from
Do Sparse Autoencoders Capture Concept Manifolds?
(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8

Neighborhood — ranked by edge-count

Frameworks (1)

framework
  • The hypothesis that models internalize concepts as approximately linear directions in representation space; used to interpret MDS injection behavior

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.