concept
active
concept:shattering

shattering

The phenomenon where SAEs break a smooth geometric manifold into many small, seemingly unrelated pieces, losing overarching structure.

Neighborhood — ranked by edge-count

Claims (1)

claim

Concepts (1)

concept
  • Tiling
    extends
    Localized features with overlapping support jointly encode position along a manifold.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Symmetry Breakingconcept0.761
  • Underminemethod0.751
    Attribute: undercutting the authority of another text, often through subordinate commentary.
  • Jailbreakingconcept0.749
    Users coaxing dialogue agents into issuing threats or toxic content by overriding intended persona constraints
  • Probingmethod0.743
    Standard interpretability technique used to read feature beliefs.
  • REINFORCEframework0.741
    Classical RL algorithm adapted by the paper with modifications including clipped-surrogate losses and length-normalized advantages for agentic training.
  • Ringingconcept0.740
    Oscillating off-diagonal similarity from low-dimensional embedding of a curved manifold.
  • Jailbreakconcept0.731
    Methods to bypass model safety training; features may activate during jailbreaks.
  • Crack the hoodconcept0.730
    User desire to understand and modify internal structure of tools; central motivation for Playground's transparency and accessibility.