method
active
method:interchange-intervention-accuracy-iia-metricInterchange Intervention Accuracy (IIA) Metric
Metric measuring accuracy of DNN under intervention at matching algorithm-predicted outputs on held-out test set
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Evaluation metric measuring how well a trained intervention matches desired counterfactual model behavior
- Proportion of aligned interchange interventions with equivalent high-level and low-level effects; graded measure of causal abstraction.
- Training technique that induces specific causal structures in neural networks by co-training with interchange interventions
- Differentiable training objective minimized when a high-level model is an abstraction of a neural network under a given alignment.
- Fundamental operation for causal abstraction analysis; forces neurons to take values from source inputs to create counterfactuals.
- Extends interchange interventions to non-standard bases by rotating representations, intervening in rotated subspaces, then rotating back.
- Open methodological question acknowledged as limitation
- Empirical support for vacuousness of unrestricted causal abstraction