concept
active
concept:rank-one-subcomponents

Rank-one subcomponents

The atomic pieces into which weight matrices are decomposed by VPD; each rank-one component is interpretable.

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • One of the simple rank-one matrices resulting from VPD that sums with others to reconstruct the original model weights and has a specific functional role.
  • Rank-one matrixconcept0.771
    The simple matrix form into which VPD constrains subcomponents to enforce mechanistic simplicity.
  • Constraint in VPD where each parameter subcomponent is constrained to be a rank-one matrix for simplicity.
  • Procedure in VPD that actively searches for combinations that break the prediction of which subcomponents are unimportant, stress-testing the decomposition.
  • The part of the emoticon subcomponent responsible for recognizing the 'eyes' of emoticons like ';', ':' or '=', which was edited in the demo.
  • Subordinationmethod0.738
    Attribute: spatial positioning that signals inferiority, using lower positioning or smaller size.
  • A structure generated by a living process, with deep interlocking and wholeness, as described in earlier volumes.
  • Assertion about the qualitative advantages of VPD's rank-one decomposition.