dataset
active
dataset:dolma-v1-7
Favorite
Dolma v1.7
Pretraining corpus.
Neighborhood — ranked by edge-count
Papers (1)
paper
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
introduces
mentions
Artifacts (1)
artifact
OLMo models (4M–4B)
uses
Pretrained from scratch with injected tasks.