concept
active
concept:mechanistic-faithfulness

Mechanistic faithfulness

Idea that decomposed components must causally reflect the model's computation; enforced by adversarial ablation in VPD.

Neighborhood — ranked by edge-count

Thinkers (1)

thinker

Frameworks (1)

framework

Claims (1)

claim

Methods (1)

method
  • Penalizing difference between transcoder and MLP Jacobians, computed cheaply via random vector products.

Concepts (3)

concept
  • Datapoint feature
    associated_with
    Transcoder feature that activates on p and produces p, memorizing something the model did not.
  • Second category of SAE/transcoder concerns, distinct from faithfulness.
  • Error features
    associated_with
    Extra feature representing unexplained error to make isomorphism exact.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.