concept
active
concept:distributed-representationDistributed representation
Idea that information is spread across many neurons; superposition is a subtype.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Model Alignment Searchmentions
Methods (1)
method
- Interchange Interventionassociated_withFundamental operation for causal abstraction analysis; forces neurons to take values from source inputs to create counterfactuals.
Concepts (1)
concept
- Residual Streamassociated_withProposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Key notion where alignment map ϕ maps neurons block-wise to latent variables before constructive abstraction
- Representations where individual neurons play multiple conceptual roles; patterns consisting of linear combinations of unit vectors.
- Cognitive process spread across human and non-human agents; a goal of Pask’s and Friedman’s cybernetic diagrams.
- CIMC's commitment that should a conscious machine be validated, its stewardship cannot be the sole purview of a single organization
- The distribution of latent representations produced by the model under unperturbed inputs
- The idea that features are encoded as directions in activation space.
- Representations of one's own mental states; associated with consciousness in higher-order theories.
- The central question of whether representational geometry implies corresponding computational structure