concept
active
concept:linear-representation

Linear representation

The idea that features are encoded as directions in activation space.

Neighborhood — ranked by edge-count

Thinkers (1)

thinker

Frameworks (1)

framework
  • Core theoretical framework: neural networks represent more features than neurons by encoding features as directions in superposition

Methods (1)

method
  • Interpretability method criticized in this paper for shattering manifolds into atomic pieces, obscuring overarching semantic structure.

Concepts (3)

concept
  • The established finding that transformer LLMs encode many interpretable concepts as linear directions in activation space
  • The central object of study — the idea that a concept like truth is encoded as a direction in the LLM's latent space
  • Truth Direction
    associated_with
    A hypothesized direction in LLM activation space that encodes the truth or falsehood of factual statements

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.