finding
active
finding:on-a-tinystories-example-tortuosity-is-77-109-for-saes-and-activations-versus-2-8-for-the-predictive-code

On a TinyStories example, tortuosity is τ≈77–109 for SAEs and activations versus τ=2.8 for the predictive code.

Fig. 5.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count