method
active
method:causal-attention-mask

Causal Attention Mask

Modification to transformer restricting keys and values to previous time-steps only, mimicking how an agent accumulates experiences.

Neighborhood — ranked by edge-count

Frameworks (1)

framework
  • The transformer version directly analogous to TEM, introduced in this paper, offering dramatic performance improvements.

Methods (1)

method
  • Attention mechanism with causal mask limiting each token's view to previous tokens; used in decoder-only transformers

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.