concept
active
concept:attention-heads

Attention heads

Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Attention
    related_to
    Selective attention mechanism is a component of GWT-2 indicator; AST-1 models and enables control over attention

Findings (1)

finding

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.