Autoregressive Text Generation

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Autoregressive Samplingmethod0.842
  The mechanism by which LLMs generate text: drawing a token from the next-token distribution and appending it to context repeatedly
• Autoregressive modelsframework0.838
  Second model system studied; used to show why flat autoregressive LLMs struggle with long-range coherence.
• Autoregressive Language Modelingconcept0.835
  Training objective interpretable as optimizing a diverse set of tasks; thus subject to multitask scaling convergence pressures
• autoregressive modelingmethod0.829
  Statistical technique where outputs are regressed on previous values; used in language generation
• autoregressive persistenceconcept0.820
  Baseline persistence of any probe direction arising from the autoregressive nature of LLMs, not specific to emotion content
• autoregressive recurrenceconcept0.810
  Transformers are recurrent through autoregression because the K/V stream provides horizontal information flow across positions, even though each forward pass is feedforward.
• autoregressive parallelizationconcept0.793
  The training parallelization technique that latent methods are difficult to train with.
• Any Text Generates Commentary Automaticallyclaim0.790