concept
active
concept:concreteness-filtering-of-sae-latentsConcreteness Filtering of SAE Latents
Pre-filtering step excluding abstract latents where off-topic detection is harder
Neighborhood — ranked by edge-count
Concepts (1)
concept
- Endogenous Steering ResistancesupportsThe central phenomenon introduced by this paper: inference-time recovery from irrelevant activation steering in LLMs
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Pre-filtering step excluding latents naturally activated by each prompt to ensure genuine off-topic steering
- Interpretable features extracted by sparse autoencoders used as steering targets in this study
- Claim that feature grounding enables interpretability metrics.
- Extension of mechanistic interpretability findings to the metacognitive domain
- Interpretability method criticized in this paper for shattering manifolds into atomic pieces, obscuring overarching semantic structure.
- Surprising finding that the two evaluation methods diverge in their relationship with persistence
- LLM-based judge rating SAE latent labels 0-100 for concreteness to filter steering candidates
- Computing attribution as the dot product of the output logit gradient with the SAE decoder weight, multiplied by feature activation.