concept
active
concept:pre-fillingPre-filling
The process by which a model reconstructs the KV cache from the transcript when moving to a new server or different model
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Task where a random word is prefilled as the assistant's response, then the model is asked whether it intended to say that word, testing introspection on prior intentions.
- Initial large-scale training phase whose early stages are shown to form persona representations
- Adversarial multi-turn experiment where first turn uses pre-finetuning model to test if follow-up maintains character
- The key novel contribution: an internal model that learns the density of familiar multisensory experiences and drives mark-removal behavior through mismatch with the free energy principle
- Key claim enabling the virtual instance view to survive server changes
- Target distribution over states or outcomes encoded in the generative model; goal states.
- Kuhn's term for a field lacking shared paradigm, methods, or objects of study; used to characterize current state of interpretability research
- The diverse distribution learned by LLMs during pretraining that alignment training sharpens; VS aims to recover it