finding
active
finding:improvement-from-scaling-is-due-to-both-data-quantity-and-data-diversityImprovement from scaling is due to both data quantity and data diversity
Shown in the full paper ablation.
Source paper
extracted_from(2025) · Adam Karvonen
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Forward-looking interpretation of scaling results.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Implication of PRH: larger models should amplify bias less and hallucinate less if they better model reality
- Implication of PRH for 'scale is all you need' argument
- Practical implication.
- Claim about broader applicability of the scaling argument
- We hypothesize that degraded generalization on benchmarks like MMLU may reflect the computational demands of the tasks.hypothesis0.760Connecting the paper's task-difficulty findings to prior observations of weak generalization on complex QA benchmarks.
- Clarification that levels of scale fails when detail is merely present but not doing anything—as in machine-made doors with superficially many panels that have no real life
- Interpretation that the absence of hierarchical scaling is the reason modern buildings feel inhuman.
- With raw data, wider spacing has little effect on accuracy except at high S and near forking points.finding0.755Raw data behavior.