claim
active
claim:yun-et-al-define-sameness-by-direction-across-layers-while-crosscoders-define-it-by-activating-on-the-same-data-points-allowing-feature-driftYun et al. define sameness by direction across layers while crosscoders define it by activating on the same data points, allowing feature drift
Conceptual difference.
Source paper
extracted_fromRelated by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Cross-layer transcoder features form a mix of local, global and intermediate features by decoder normfinding0.792Preliminary decoder norm analysis.
- Circuit simplification theory.
- Consistent but alternative explanations like amplification exist.
- Motivation for DFC.
- Discussion.
- Decoder norm profile across 18 layers.
- Motivating example with 13 vs 3 features.
- Features not merely relayed via residual connections.