concept
active
concept:mixingMixing
The extent to which attention mechanism incorporates information from previous tokens at each layer, used to characterize stages of inference
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Average row entropy of attention matrices per layer and head, measuring information mixing across tokens
- Using pure pigments mixed in lime, cement, or other bases rather than tinted white-base commercial paints, allowing saturated, adjustable colors.
- Key property enabling organized collective action; mechanism by which parts coordinate into functional wholes.
- Dynamic condition: penetrating into deeper layers of a text, entering nested frames.
- Central concept: how meaning of wholes depends on meanings of parts and their structural arrangement; multiple formulations explored (Frege, Schrödinger, Whitehead, LEGO).
- A process that combines multiple input streams into a single stream, required in Parlog86 for many-to-one communication.
- The standard evolutionary theory integrating Darwinian selection with Mendelian genetics; paper argues it needs expansion with MCA.