concept
active
concept:privileged-basis

Privileged Basis

A property of activations where neural network features align with basis dimensions due to sparse activation functions; absent in the residual stream but present in tokens, attention patterns, and MLP activations

Neighborhood — ranked by edge-count

Papers (1)

paper

Concepts (2)

concept
  • Superposition
    associated_with
    Phenomenon where models represent more features than dimensions via almost-orthogonal directions.
  • Polysemanticity
    associated_with
    Neurons that respond to multiple unrelated concepts, limiting interpretability.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.