concept
active
concept:interference-weightsInterference Weights
Logit weight contributions from a feature that arise due to superposition with other features, not from the feature's own causal role
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- When non-orthogonal features cause logistic regression to identify a suboptimal probe direction
- Baseline MTL approach minimizing sum of task losses with equal weights; suffers from task balancing
- Coefficient weighting each task loss in the MTL objective.
- Editing network weights to test predictions about circuit function; proposed as falsifiability test for circuit claims
- Asymmetric transfer after fine-tuning: high-density bases (B10) are more robust.
- Autoencoder design choice to learn separate encoder and decoder weights, increasing representational capacity by allowing encoder vectors to distinguish similar features
- Implicit weights directly connecting any pair of layers computed by multiplying output weights of one layer with input weights of another through the residual stream
- The space of the model's parameter matrices, where VPD operations take place.