finding
active
finding:intrinsic-dimension-of-gemma-2-2b-and-llama-3-1-8b-activations-increases-steadily-with-sequence-position-while-a-stationary-surrogate-stays-nearly-constant

Intrinsic dimension of Gemma-2-2B and Llama-3.1-8B activations increases steadily with sequence position, while a stationary surrogate stays nearly constant.

Fig. 2a,e.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.