claim
active
claim:low-reconstruction-error-alone-does-not-guarantee-coherent-manifold-recoveryLow reconstruction error alone does not guarantee coherent manifold recovery
Geometry preserved but not organized usefully.
Source paper
extracted_from(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Central empirical interpretation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Features act as local patch detectors.
- Measures how well an intervened point can be expressed as a convex combination of nearby natural manifold points
- Open question in limitations.
- SAE reconstruction error direction and norm are largely linearly predictable from the activation vectorfinding0.735Errors are structured not random.
- Manifold-level descriptions recover overarching semantic structure that SAE features miss.claim0.732Positive claim that geometric descriptions retain the conceptual coherence lost in atomized feature decompositions.
- Future-work perspective.
- Justifies focusing on direction-based SAEs.
- Appendix claim.