method
active
method:cross-layer-transcoder-clt

Cross-layer transcoder (CLT)

Replacement model architecture with 30M features replacing MLP neurons.

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Phenomenon where models represent more features than dimensions via almost-orthogonal directions.

Methods (3)

method
  • Gradient-based technique using SAE features to estimate causal effects on completions; used to corroborate NLA findings.
  • Sparse dictionary learning variant that reads and writes to multiple layers or models, yielding shared features.
  • CLT plus error nodes and original attention patterns, local to a prompt.

Conceptual bridges

2-hop · via this method's ideas

Where ideas in this method connect to the rest of the corpus — the same concept, an analogy, or a restatement elsewhere.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.