method
active
method:causally-masked-attention

causally-masked attention

Attention mechanism with causal mask limiting each token's view to previous tokens; used in decoder-only transformers

Neighborhood — ranked by edge-count

Methods (1)

method
  • Modification to transformer restricting keys and values to previous time-steps only, mimicking how an agent accumulates experiences.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.