Transformer Neural Network

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Neural Networksconcept0.827
• R-Transformer: Recurrent Neural Network Enhanced Transformer (Wang et al., 2019)concept0.812
  Prior work on recurrently generated position encodings; cited as precedent for TEM-t's recurrent position encoding method.
• Graph Neural Network (GNN) Analogy to Transformersconcept0.803
  Informal analogy mentioned by Joshi treating attention patterns as weights on a graph, framing transformer tensor products as graph convolutions
• Convolutional Neural Networksmethod0.787
  Biologically-inspired AI architecture cited as a successful example of bioinspiration from visual cortex organization
• Neural-network agentsconcept0.778
  The artificial agents trained with RL in this study, whose latent dynamics are analyzed for causal emergence.
• Feature (neural network)concept0.758
  Scalar function of the input corresponding to a direction in the vector space of neuron activations; claimed to be the fundamental unit of neural networks
• Cortex as a Transformerhypothesis0.757
  Hypothesis that neocortical circuits beyond hippocampus may implement transformer-like computations for language and other domains.
• Neural Network Interpretabilityconcept0.754
  The field aimed at understanding what neural networks have learned; characterized as pre-paradigmatic in this paper