method
active
method:sae-latent-steeringSAE Latent Steering
Adding a multiple of the SAE latent decoder vector to token activations to causally test each latent's role in misalignment
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Method of adding scaled versions of sparse autoencoder latent features during generation to causally modulate model behavior
- Interpretable features extracted by sparse autoencoders used as steering targets in this study
- Tests whether deception- and roleplay-related features causally gate consciousness self-reports in LLaMA 3.3 70B
- Shows gating effect is specific to the self-referential computational regime, not a general feature effect
- Using GPT-4o or o3 to automatically generate interpretations of SAE latents from top-activating examples
- Pre-filtering step excluding latents naturally activated by each prompt to ensure genuine off-topic steering
- The most decreased latent after bad-advice fine-tuning is also the most effective re-aligning latent
- The individual, supposedly monosemantic directions learned by SAEs; argued here to fragment manifolds into disconnected pieces.