concept
active
concept:rank-one-subcomponentsRank-one subcomponents
The atomic pieces into which weight matrices are decomposed by VPD; each rank-one component is interpretable.
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- One of the simple rank-one matrices resulting from VPD that sums with others to reconstruct the original model weights and has a specific functional role.
- The simple matrix form into which VPD constrains subcomponents to enforce mechanistic simplicity.
- Constraint in VPD where each parameter subcomponent is constrained to be a rank-one matrix for simplicity.
- Procedure in VPD that actively searches for combinations that break the prediction of which subcomponents are unimportant, stress-testing the decomposition.
- The part of the emoticon subcomponent responsible for recognizing the 'eyes' of emoticons like ';', ':' or '=', which was edited in the demo.
- Attribute: spatial positioning that signals inferiority, using lower positioning or smaller size.
- A structure generated by a living process, with deep interlocking and wholeness, as described in earlier volumes.
- Assertion about the qualitative advantages of VPD's rank-one decomposition.