concept
active
concept:representational-disentanglementRepresentational Disentanglement
CIMC's characterization of part of the solution to the Hard Problem: insight into the structural necessities of phenomenal representation
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Adjacent ML literature on separating independent factors of variation; related to but distinct from the polysemanticity problem studied here
- Related research agenda seeking representations that separate conceptually distinct factors; contrasted with superposition approach
- Independent concepts are encoded by separate latents.
- Core phenomenon studied: when causal interventions shift internal representations away from the natural distribution
- The central question of whether representational geometry implies corresponding computational structure
- The evolution of an agent's latent representations over the course of training, shown to align with reward improvement when causal emergence is high.
- SAE-derived representation space where individual dimensions activate for distinct concepts, enabling cleaner steering
- The aspect of design dealing with data structures, modules, and implementation.