Attention is All You Need (Vaswani et al., 2017)

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• paying attention to the wholenessconcept0.776
  The act of seeing and feeling the entire field of centers at a place, which Alexander equates with love of life.
• Self-attentionconcept0.767
  A form of key-query attention within a single input sequence; core to Transformers.
• Attention headsconcept0.746
  Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).
• attention computationconcept0.737
  Process using Q, K, V to compute a heat map over K and weighted sum of V.
• Attention is a generalization of convolution; all convolutions can be expressed as tensor products of fixed relative position attention patterns and weight matricesclaim0.736
  Mathematical equivalence showing the relationship between attention mechanisms and convolutional operations
• attention mechanismconcept0.728
  Core operation in transformers, computing weighted combinations of previous elements
• Everything matters.claim0.724
  New cosmological assumption #4: no action is exempt from contributing to life or death.
• This is the only building I have ever been in, where absolutely everything is necessary.quote0.723
  Spontaneous testimony from a homeless man staying at the Julian Street Inn, highlighting the perceived integral necessity of all details.