concept
active
concept:inference-cost

Inference cost

Computational expense proportional to number of generated tokens, targeted for reduction by ReflCtrl

Neighborhood — ranked by edge-count

Claims (1)

claim

Concepts (1)

concept
  • Self-reflection
    associated_with
    The ability of reasoning LLMs to review and revise previous reasoning steps during inference

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Expected Costconcept0.780
    The KL divergence between predicted and preferred outcomes, minimized by policies that realize prior preferences.
  • Paradigm of improving model outputs through more computation at inference time; VS is presented as a diversity-oriented alternative
  • Stages of Inferenceframework0.770
    The perspective that LLM inference decomposes into distinct computational stages, which the paper extends to looped models
  • The process of inferring causes of sensory inputs, a key aspect of the free-energy minimization scheme.
  • Methodological principle applied to favor identity over correlation between signed evaluation and felt valence
  • Attributing subjective experience based on observable embodied behaviours.
  • Embodied Inferenceconcept0.743
    Process by which organism's material states and internal dynamics realize variational inference through action