finding
active
finding:assistant-only-saes-reconstruct-user-turns-1-5-3-worse-both-roles-training-cuts-user-turn-nmse-53-63Assistant-only SAEs reconstruct user turns 1.5–3× worse; both-roles training cuts user-turn nMSE 53–63%
Appendix G.
Source paper
extracted_from(2026) · Kevin Der · Harish Kamath · Thompson, Ben
Neighborhood — ranked by edge-count
Papers (1)
paper
Frameworks (1)
framework
- Turn-Averaged SAEcitesPaper's main proposal: SAE trained on the mean activation across a turn.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Table 1 on Qwen-2.5-7B holdout.
- Table 1.
- Broadly, turn-averaged SAEs make interpretability techniques practical at long context lengths.quote0.781Abstract thesis.
- Table 1.
- Table 1.
- Table 1.
- Quantifies SAE reconstruction damage.
- Limitation statement.