finding
active
finding:within-task-variance-of-model-performance-is-large-circuits-approximate-average-case-but-poorly-individual-data-points

Within-task variance of model performance is large: circuits approximate average case but poorly individual data points

Undermines concept-based task definition in circuit discovery.

Source paper

extracted_from
Open Problems in Mechanistic Interpretability
(2025) · Lee Sharkey · Bilal I. Chughtai · Joshua Batson · Jack W. Lindsey +25

Neighborhood — ranked by edge-count

Claims (1)

claim

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.