concept
active
concept:fisher-information-matrixFisher Information Matrix
Curvature proxy approximated by K-FAC.
Neighborhood — ranked by edge-count
Papers (1)
paper
Frameworks (1)
framework
- Approximates FIM as G⊗A to give dataset-average curvature eigenbasis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- An OV circuit matrix that maps tokens to increasing the logit of those same tokens; detectable via positive eigenvalues
- Prescribes transitions among hidden state factors under action; encodes policy-dependent dynamics
- The simple matrix form into which VPD constrains subcomponents to enforce mechanistic simplicity.
- Second-order KL estimate of a weight's effect on outputs using Fisher metric.
- The core idea of decomposing weight matrices into components for interpretability.
- High-dimensional array mapping hidden states to outcomes; key learned quantity in the paradigm
- Proposed theoretical framework combining qualitative and quantitative aspects of information, with explicit treatment of processes and information flow; central organizing concept for the paper.
- Key mathematical object in DAS; transforms neural representations to alternative bases to reveal distributed structure.