RedPajama

Large-scale English pretraining corpus used as a proxy for the pretraining distribution to validate VS alignment

Neighborhood — ranked by edge-count

paper