Mixture-of-Experts architecture

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Mixture-of-Experts (MoE)concept0.807
  Architecture of Mixtral-8x7B; uses sparse expert routing affecting how hidden states are computed across layers.
• Agent architecturesconcept0.773
  The varied neural network architectures used in the RL experiments to test whether the alignment phenomenon generalizes across architectures.
• information architectureconcept0.738
  Field Steenson worked in (1997 onwards); term denoting structural design of information systems; borrowed 'architecture' from computer design.
• Cognitive Architectureconcept0.736
  The compositional structure of the psyche introduced by Newell and Simon; the paper uses it to decompose mind into conscious and unconscious parts
• Multiscale Competency Architectureframework0.732
  A framework originating from Levin that formalizes how hierarchical biological systems—from cells to tissues to organs—exhibit integrated problem-solving and adaptive plasticity across multiple levels of organization (metabolic, transcriptional, physiological, anatomical). It models system-level behaviors as emergent from competition and cooperation among heterogeneous subunits within composite agents, explaining how goals and regulations scale across biological scales.
• ensemble of agentsconcept0.728
  Probabilistic behaviour of an ensemble used to derive the free-energy principle.
• Perceiver architectureconcept0.727
  Architecture using a latent space with cross-attention to handle multimodal inputs; argued to implement a global workspace.
• Architectural Intelligence (concept)framework0.724
  Steenson's overarching concept linking architecture and digital design history; the title theme of her 2017 book.