finding
active
finding:restricted-r2-variance-explained-on-llama3-1-8b-plateaus-well-beyond-each-manifold-s-ambient-dimension-across-five-sae-architectures

Restricted-R² variance explained on Llama3.1-8B plateaus well beyond each manifold's ambient dimension across five SAE architectures

SAEs do not achieve compact capture; they are in dilution.

Source paper

extracted_from
Do Sparse Autoencoders Capture Concept Manifolds?
(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.