concept
active
concept:rank-one-matrixRank-one matrix
The simple matrix form into which VPD constrains subcomponents to enforce mechanistic simplicity.
Neighborhood — ranked by edge-count
Methods (1)
method
- Rank-one matrix decompositionimplementsConstraint in VPD where each parameter subcomponent is constrained to be a rank-one matrix for simplicity.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The atomic pieces into which weight matrices are decomposed by VPD; each rank-one component is interpretable.
- An OV circuit matrix that maps tokens to increasing the logit of those same tokens; detectable via positive eigenvalues
- Prescribes transitions among hidden state factors under action; encodes policy-dependent dynamics
- Core design principle of VPD: each parameter subcomponent is constrained to be a simple rank-one matrix to enable isolated understanding and combination.
- Key mathematical object in DAS; transforms neural representations to alternative bases to reveal distributed structure.
- A structure generated by a living process, with deep interlocking and wholeness, as described in earlier volumes.
- The core idea of decomposing weight matrices into components for interpretability.
- An ordering of texts via spatial cues like indentation, size, and placement, implying importance.