finding
active
finding:k-fac-eigenvector-bands-show-sorted-activation-strength-top10-10-25-25-50-bottom50-unlike-svd

K-FAC eigenvector bands show sorted activation strength top10%>10-25%>25-50%>bottom50%, unlike SVD

Supports curvature basis interpretability.

Source paper

extracted_from
From Memorization to Reasoning in the Spectrum of Loss Curvature
(2025) · Merullo, Jack · Vatsavaya, Srihita · Bushnaq, Lucius · Lewis, Owen

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.