concept
active
concept:attentional-mode

attentional mode

Variable aperture of attention, ranging from collapsed to expanded; human and model analogs.

Neighborhood — ranked by edge-count

Papers (1)

paper

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Attentional featuresframework0.839
    Proposed attention analog of sparse monosemantic features for decomposing attention layers.
  • Attentional Stateconcept0.818
    Higher-order generative model variables modulating perceptual precision; subject to policy selection (deliberate shifts of attention).
  • Attentionconcept0.807
    Selective attention mechanism is a component of GWT-2 indicator; AST-1 models and enables control over attention
  • Core operation in transformers, computing weighted combinations of previous elements
  • Process using Q, K, V to compute a heat map over K and weighted sum of V.
  • Expectation for decomposition.
  • Attention biologyconcept0.763
    Study of what attentional features and head behaviors exist.
  • Attention streamsconcept0.759
    Term introduced by this paper for the horizontal axis of information flow in transformers across token-positions via attention heads