concept
active
concept:fisher-information-matrix

Fisher Information Matrix

Curvature proxy approximated by K-FAC.

Neighborhood — ranked by edge-count

Frameworks (1)

framework

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Copying Matrixconcept0.750
    An OV circuit matrix that maps tokens to increasing the logit of those same tokens; detectable via positive eigenvalues
  • Prescribes transitions among hidden state factors under action; encodes policy-dependent dynamics
  • Rank-one matrixconcept0.731
    The simple matrix form into which VPD constrains subcomponents to enforce mechanistic simplicity.
  • Second-order KL estimate of a weight's effect on outputs using Fisher metric.
  • The core idea of decomposing weight matrices into components for interpretability.
  • High-dimensional array mapping hidden states to outcomes; key learned quantity in the paradigm
  • Information Dynamicsframework0.699
    Proposed theoretical framework combining qualitative and quantitative aspects of information, with explicit treatment of processes and information flow; central organizing concept for the paper.
  • Key mathematical object in DAS; transforms neural representations to alternative bases to reveal distributed structure.