method
active
method:next-token-prediction-ntpNext-Token Prediction (NTP)
Training objective used for all neural network models in the paper; cross-entropy loss over predicted token sequences.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The training objective of LLMs: predicting the most likely next token given context; formally P(w_{n+1}|w_1...w_n)
- The core mechanism of LLMs: predicting the next token based on previous context.
- NLI class indicating neither entailment nor contradiction; weighted 0 in Baseline but +1 in Neutral NLI Diversity
- Evidence humans and AI use different representations.
- Extension of compositional methods beyond natural language processing to general AI and hardware
- Quantitative argument for the richness of quasi-psychological connections enabled by attention streams
- Load-bearing mechanistic conjecture about why persona vectors generalize from extraction to prediction
- Author's hypothesis explaining why persona vectors extracted from exhibited-trait activations generalize to causal influence