finding
active
finding:vpd-scales-to-a-4-layer-67m-parameter-model-trained-on-the-pile

VPD scales to a 4-layer 67M-parameter model trained on The Pile.

Empirical demonstration of VPD on a mid-scale transformer, establishing feasibility.

Source paper

extracted_from
Interpreting Language Model Parameters
(2026) · Bushnaq, Lucius · Braun, Dan · Clive-Griffin, Oliver · Bussmann, Bart +4

Neighborhood — ranked by edge-count

Concepts (1)

concept

Datasets (1)

dataset
  • Training corpus used for the 67M-parameter model tested with VPD.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.