concept
active
concept:attention-decay

Attention Decay

Decrease in attention paid to system prompt over conversational turns, leading to persona fidelity degradation (cited from Li et al.)

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Persona drift
    associated_with
    Behavioural drift in multi-turn LLM interaction; documented in prior work for persona, identity, and instruction-following

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Attentionconcept0.822
    Selective attention mechanism is a component of GWT-2 indicator; AST-1 models and enables control over attention
  • Formal model of meditation phenomenology: focus → distraction → awareness of distraction → redirection, derived from active inference.
  • Attentional Stateconcept0.777
    Higher-order generative model variables modulating perceptual precision; subject to policy selection (deliberate shifts of attention).
  • Self-attentionconcept0.770
    A form of key-query attention within a single input sequence; core to Transformers.
  • Core operation in transformers, computing weighted combinations of previous elements
  • Attention Sinkconcept0.764
    Phenomenon where layers concentrate most attention weight on the first token, captured by ColSum Concentration metric
  • Process using Q, K, V to compute a heat map over K and weighted sum of V.
  • Decision-making phenomenon reproduced by active inference in parietal/prefrontal cortex.