claim
active
claim:predictive-component-not-dominating-at-deep-layers-is-a-feature-since-deeper-layers-discard-contextual-information-needed-for-unembedding

Predictive component not dominating at deep layers is a feature, since deeper layers discard contextual information needed for unembedding.

Layer choice discussion.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.