Selective attention mechanism

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• attention computationconcept0.791
  Process using Q, K, V to compute a heat map over K and weighted sum of V.
• Focused Attention Cycleconcept0.773
  Formal model of meditation phenomenology: focus → distraction → awareness of distraction → redirection, derived from active inference.
• Self-attentionconcept0.768
  A form of key-query attention within a single input sequence; core to Transformers.
• Selectivitymethod0.768
  Adapted control task metric measuring difference between odds-ratio on original task and arbitrary-label control task
• Anomaly detection mechanismconcept0.758
  A possible circuit that triggers when activations deviate from expected values, hypothesized to underlie noticing injected thoughts.
• Attention is a generalization of convolution; all convolutions can be expressed as tensor products of fixed relative position attention patterns and weight matricesclaim0.757
  Mathematical equivalence showing the relationship between attention mechanisms and convolutional operations
• Attention algorithms are usually distributed across attention headsclaim0.756
  Claim supported by VPD's recovery of cross-head attention subcomponents, noted in footnote.
• auction mechanismconcept0.752
  Competitive bidding to acquire animal cards, with buy-right option for auctioneer.