claim
active
claim:current-saes-capture-only-a-fraction-of-model-computation-due-to-limited-training-data-and-incomplete-reconstructionCurrent SAEs capture only a fraction of model computation due to limited training data and incomplete reconstruction
Limitation statement.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- SAE dark matter / incomplete reconstructionassociated_withSAEs capture only a fraction of model computation.
Questions (1)
question
- Open question in limitations.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Pivotal shift that created the faithfulness problem.
- Central research question.
- Quantifies SAE reconstruction damage.
- App. B.
- Fig 2 right.
- SAE reconstruction error direction and norm are largely linearly predictable from the activation vectorfinding0.775Errors are structured not random.
- Source of mismatch.
- Related to point-based simplicial limit.