framework
active
framework:stages-of-inference

Stages of Inference

The perspective that LLM inference decomposes into distinct computational stages, which the paper extends to looped models

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • The process of inferring causes of sensory inputs, a key aspect of the free-energy minimization scheme.
  • Embodied Inferenceconcept0.783
    Process by which organism's material states and internal dynamics realize variational inference through action
  • Algorithmic framework for probabilistic inference in graphical models.
  • Paradigm of improving model outputs through more computation at inference time; VS is presented as a diversity-oriented alternative
  • Attributing subjective experience based on observable embodied behaviours.
  • Inference costconcept0.770
    Computational expense proportional to number of generated tokens, targeted for reduction by ReflCtrl