concept
active
concept:pre-filling

Pre-filling

The process by which a model reconstructs the KV cache from the transcript when moving to a new server or different model

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Task where a random word is prefilled as the assistant's response, then the model is asked whether it intended to say that word, testing introspection on prior intentions.
  • Pretrainingconcept0.736
    Initial large-scale training phase whose early stages are shown to form persona representations
  • Prefill Attackmethod0.735
    Adversarial multi-turn experiment where first turn uses pre-finetuning model to test if follow-up maintains character
  • Self-Priorframework0.731
    The key novel contribution: an internal model that learns the density of familiar multisensory experiences and drives mark-removal behavior through mismatch with the free energy principle
  • Key claim enabling the virtual instance view to survive server changes
  • Prior Preferencesconcept0.719
    Target distribution over states or outcomes encoded in the generative model; goal states.
  • Kuhn's term for a field lacking shared paradigm, methods, or objects of study; used to characterize current state of interpretability research
  • The diverse distribution learned by LLMs during pretraining that alignment training sharpens; VS aims to recover it