#2.8 trillion tokens

2.8 Trillion Tokens: 1 AI articles covering 2.8 trillion tokens news, analysis, and research

Articles

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open DataNEW⭐9

📅 1小时前👁 4 views

The bodhan-ai/indic-translate release pairs an 8B model with an open data pipeline and a 2.8 trillion-token corpus to close the Indic pretraining data gap.