finding
active
finding:jumprelu-saes-also-plateau-after-2d-i-latents-with-radial-variationJumpReLU SAEs also plateau after ~2d_i latents with radial variation
Fig 6.
Source paper
extracted_from(2025) · Michaud, Eric J. · Gorton, Liv · McGrath, Tom
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
- Core concern.
- Appendix A.1.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Strongest argument against pathology.
- Ignition-like effect.
- Reconstruction cannot rank featurizers.
- Higher-dimensional hyperspheres accommodate ≥10^4 latents without plateau; β≈0.05 for dim 6-8finding0.733Fig 5.
- Design justification.
- ReLU/JumpReLU restrict blocks to a cone and fail to recover superpositions a signed code resolves.claim0.716Justifies no coordinate-wise nonlinearity.
- Fig. 23.
- App. E.