finding
active
finding:higher-dimensional-hyperspheres-accommodate-10-4-latents-without-plateau-0-05-for-dim-6-8Higher-dimensional hyperspheres accommodate ≥10^4 latents without plateau; β≈0.05 for dim 6-8
Fig 5.
Source paper
extracted_from(2025) · Michaud, Eric J. · Gorton, Liv · McGrath, Tom
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
- When β<α, SAEs can optimally tile common feature manifolds at the expense of discovering rarer featuresassociated_withCore concern.
- Synthetic experiments.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Strongest argument against pathology.
- On DINOv3, classification and segmentation tolerate R²≈0.8, while depth needs R²≈0.9 to retain 95% accuracy.finding0.737Task-dependent distortion floors.
- Fig 6.
- How high-dimensional is the space of all model personas, and does there exist a natural persona basis?question0.731Open question proposed by authors for future research on characterizing the full space of personas
- SAEs do not achieve compact capture; they are in dilution.
- Capacity.
- At Llama layer 26 (~81% depth) the predictive component does not dominate the latent norm.finding0.728Fig. 14.
- Key geometry-to-behavior bridge finding in E3; robust to pooling choice, cosine vs. L2, and frozen external encoder