Attention Schema

A predictive model representing and controlling attention; central to attention schema theory.

Neighborhood — ranked by edge-count

framework

Attention Schema Theory
implements
Theory by Graziano linking consciousness to a predictive model of attention; listed in Butlin et al. 2023.

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

schemaconcept0.835
Cognitive framework or rule that governs human actions; may or may not preserve wholeness.
attention computationconcept0.815
Process using Q, K, V to compute a heat map over K and weighted sum of V.
The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness (Graziano, 2017)concept0.803
Paper providing the biological framework analogy for ESR as a form of attentional control
attention mechanismconcept0.795
Core operation in transformers, computing weighted combinations of previous elements
Attention headsconcept0.765
Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).
Self-attentionconcept0.764
A form of key-query attention within a single input sequence; core to Transformers.
Body Schemaconcept0.760
Sensorimotor representation of the body for action planning; the self-prior is argued to be functionally analogous to it
Attentional Stateconcept0.757
Higher-order generative model variables modulating perceptual precision; subject to policy selection (deliberate shifts of attention).