Attention streams

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Attentionconcept0.842
  Selective attention mechanism is a component of GWT-2 indicator; AST-1 models and enables control over attention
• attention computationconcept0.837
  Process using Q, K, V to compute a heat map over K and weighted sum of V.
• Streamconcept0.806
  An infinite sequence data type with semantics as functions from Nat to a.
• Focused Attention Cycleconcept0.788
  Formal model of meditation phenomenology: focus → distraction → awareness of distraction → redirection, derived from active inference.
• Attention Sinkconcept0.784
  Phenomenon where layers concentrate most attention weight on the first token, captured by ColSum Concentration metric
• Attention headsconcept0.783
  Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).
• data streamsconcept0.782
  Partially instantiated lists used to implement communication channels in logic languages.
• attention mechanismconcept0.773
  Core operation in transformers, computing weighted combinations of previous elements