question
active
question:what-assumptions-about-temporal-structures-do-saes-make-and-how-do-they-align-with-the-actual-temporal-structure-in-a-lm-s-activations

What assumptions about temporal structures do SAEs make, and how do they align with the actual temporal structure in a LM's activations?

Motivating question.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.