finding
active
finding:at-olmo-7b-layer-22-mlp-input-bottom-50-k-fac-eigenvectors-activate-23-1-more-on-memorized-data-top-10-activate-26-more-on-clean

At OLMo-7B layer 22 MLP input, bottom 50% K-FAC eigenvectors activate 23.1% more on memorized data; top 10% activate 26% more on clean

Disentanglement evidence.

Source paper

extracted_from
From Memorization to Reasoning in the Spectrum of Loss Curvature
(2025) · Merullo, Jack · Vatsavaya, Srihita · Bushnaq, Lucius · Lewis, Owen

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.