finding
active
finding:ising-pipeline-on-batchtopk-sae-layer-19-8-k-64-recovers-temperature-colors-and-political-bias-manifolds-as-distinct-communitiesIsing pipeline on BatchTopK SAE (layer 19, ×8, k=64) recovers temperature, colors, and political bias manifolds as distinct communities
Unsupervised recovery of known manifolds.
Source paper
extracted_from(2026) · Usha Bhalla · Thomas Fel · Can Rager · Sheridan Feucht +8
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Limitation statement.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- SAEs may have the right inductive biases for deeper layers but not middle or earlier layers.claim0.770Speculation about layer dependence.
- App. B.
- Limitation.
- Evaluated architecture.
- Hypothesis-generating discovery.
- Probing limited.
- Third checkpointing strategy; adopted here.
- SAE reconstructions on Llama-3-8B layer 25 produce intervened EMD exceeding the natural-natural baselinefinding0.733Empirical demonstration that SAE projections produce divergent representations in a real LLM