concept
active
concept:virtual-weights

Virtual Weights

Implicit weights directly connecting any pair of layers computed by multiplying output weights of one layer with input weights of another through the residual stream

Neighborhood — ranked by edge-count

Frameworks (1)

framework

Claims (1)

claim

Concepts (2)

concept
  • Residual Stream
    associated_with
    Proposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
  • Polysemanticity
    associated_with
    Neurons that respond to multiple unrelated concepts, limiting interpretability.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.