Attention Schema

A predictive model representing and controlling attention; central to attention schema theory.

Neighborhood — ranked by edge-count

framework

Attention Schema Theory
implements
Theory by Graziano linking consciousness to a predictive model of attention; listed in Butlin et al. 2023.

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Attentionconcept0.836
Selective attention mechanism is a component of GWT-2 indicator; AST-1 models and enables control over attention
schemaconcept0.835
Cognitive framework or rule that governs human actions; may or may not preserve wholeness.
attention computationconcept0.815
Process using Q, K, V to compute a heat map over K and weighted sum of V.
The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness (Graziano, 2017)concept0.803
Paper providing the biological framework analogy for ESR as a form of attentional control
attention mechanismconcept0.795
Core operation in transformers, computing weighted combinations of previous elements
Attention headsconcept0.765
Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).
Self-attentionconcept0.764
A form of key-query attention within a single input sequence; core to Transformers.
Grouped Query Attentionframework0.762
Variant of multi-head attention used in Llama3 and Qwen2.5 models evaluated in this paper