framework
active
framework:linear-representation-hypothesis

Linear Representation Hypothesis

The hypothesis that models internalize concepts as approximately linear directions in representation space; used to interpret MDS injection behavior

Neighborhood — ranked by edge-count

Thinkers (2)

thinker
  • Chris Olah
    studies
  • Kiho Park
    introduces
    Formalized the Linear Representation Hypothesis in the ICML 2024 paper

Methods (6)

method
  • Causal intervention technique: edit NLA explanation, reconstruct via AR, use difference as steering vector to manipulate model behavior.
  • The core method introduced in this paper: finds alignments between high-level causal variables and distributed neural representations via gradient descent.
  • Linear Probing
    implements
    Used to evaluate representation quality across VTAB tasks
  • Method for extracting linear directions by subtracting mean activations of contrastive groups; used to define the Assistant Axis
  • Core intervention method used throughout CausalGym; operates on one-dimensional non-basis-aligned subspace of activation space
  • Alignment map ϕ(h)=W_orth*h using orthogonal matrix; assumes linear representation hypothesis

Concepts (4)

concept

Frameworks (7)

framework

Findings (1)

finding

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.