Scaling Indic pretraining: 2.8 trillion tokens and an open data generation pipeline
Read original on Hugging Face ↗Original headline: "Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline"
Timeline
- October 16, 2026 Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline Hugging Face