method
active
method:logit-lens

Logit Lens

Unsupervised interpretability technique that projects activations through unembedding matrix; provides comparison point for NLA approach.

Neighborhood — ranked by edge-count

Thinkers (1)

thinker
  • nostalgebraist
    introduces
    Author of LessWrong post deriding GPT-3 evaluations, advocate of ecological evaluation.

Frameworks (1)

framework

Findings (1)

finding

Concepts (3)

concept
  • Proposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
  • Linear representations of emotion concepts extracted from activations.
  • The mid-to-late layer computational process that converts routed perturbation signals into explicit predictions

Methods (4)

method
  • Core unsupervised method for generating natural language explanations of LLM activations through a verbalizer-reconstructor pair trained with RL.
  • Gurnee et al.'s interpretability method used to identify the J-space workspace.
  • Tuned lens
    extends
    Baseline lens that skips ahead to output.
  • Baseline from Minder et al. combining Patchscopes, logit lens and steering.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.