framework
active
framework:attentional-features

Attentional features

Proposed attention analog of sparse monosemantic features for decomposing attention layers.

Neighborhood — ranked by edge-count

Methods (1)

method
  • Transcoders
    analogous_to
    Decomposition method for activations; VPD is compared against transcoders in sparsity-reconstruction tradeoff.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.