concept
active
concept:linear-representation-of-conceptsLinear Representation of Concepts
The established finding that transformer LLMs encode many interpretable concepts as linear directions in activation space
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (3)
concept
- Linear representationrelated_toThe idea that features are encoded as directions in activation space.
- Linear Representation of Featuresrelated_toThe central object of study — the idea that a concept like truth is encoded as a direction in the LLM's latent space
- The finding that interpretable concepts including character traits are encoded as linear directions in transformer residual streams
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Mechanistic open question.
- The hypothesis that models internalize concepts as approximately linear directions in representation space; used to interpret MDS injection behavior
- How a neural network encodes a semantic concept internally, argued to be better captured by manifolds than by atomic features.
- The sequential, continuous order of text, often challenged by diagrammatic branching.
- Activations are sums of sparse features living in subspaces.
- Correlative technique measuring the type of information encoded in distributed representations via linear predictability.
- Open question A.1.1a.2.
- Core contribution: the impasse where lifting linearity in alignment maps makes causal abstraction vacuous, but keeping it may miss non-linearly encoded features