Distributed Abstraction

Key notion where alignment map ϕ maps neurons block-wise to latent variables before constructive abstraction

Neighborhood — ranked by edge-count

concept

Constructive Abstraction
extends
Type of abstraction map where node information is computed from non-overlapping neuron sets
Input-Restricted Intervention
associated_with
Practical restriction of interventions to those producible by actual inputs; standard in DAS practice

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Latent Variables in Distributed Abstractionconcept0.843
Output of alignment map ϕ applied to DNN hidden states; basis for distributed causal abstraction
Distributed representationconcept0.832
Idea that information is spread across many neurons; superposition is a subtype.
distributed cognitionconcept0.823
Cognitive process spread across human and non-human agents; a goal of Pask’s and Friedman’s cybernetic diagrams.
Distributed Cognition in AIconcept0.792
Causal abstractionconcept0.790
A framework the paper uses alongside feature geometry to deepen mechanistic understanding of LMs
Abstraction Leakconcept0.786
Failure of semantic type class morphism; indicates design flaw where type behavior violates its semantic meaning.
interpretive abstraction (method)method0.777
Programming technique to restructure a fine-grained Linda program for efficiency by replacing live data structures with passive ones and coarser-grain processes.
distributed hash tablesconcept0.775
Implementation technique used in Linda ports for distributed-memory machines like the Intel hypercube.