claim
active
claim:saes-may-have-the-right-inductive-biases-for-deeper-layers-but-not-middle-or-earlier-layers

SAEs may have the right inductive biases for deeper layers but not middle or earlier layers.

Speculation about layer dependence.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.