method
active
method:transcoder

Transcoder

Uses activations from one layer to predict the next; special case of crosscoders.

Neighborhood — ranked by edge-count

Methods (3)

method
  • Transcoders
    related_to
    Decomposition method for activations; VPD is compared against transcoders in sparsity-reconstruction tradeoff.
  • Used to express MLP in monosemantic features, 4096 features with JumpReLU.
  • Sparse dictionary learning variant that reads and writes to multiple layers or models, yielding shared features.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.