finding
active
finding:up-to-80-of-variance-of-x-t-is-explained-by-a-500-token-preceding-context-on-pile-samples

Up to 80% of variance of x_t is explained by a 500-token preceding context on Pile samples.

Fig. 2d,h.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.