framework
active
framework:virtual-weight-model-vw-model

Virtual weight model (VW model)

Rewriting of the 1L transformer into six families of virtual weights over tokens, positions, features, logits.

Neighborhood — ranked by edge-count

Methods (1)

method

Concepts (1)

concept
  • Virtual Weights
    implements
    Implicit weights directly connecting any pair of layers computed by multiplying output weights of one layer with input weights of another through the residual stream

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.