google-research-datasets/dakshina

The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the dataset includes a large collection of native script Wikipedia text, a romanization lexicon of words in the native script with attested romanizations, and some full sentence parallel data in both a native script of the language and the basic Latin alphabet.

1 best points · 0 comments · 1 Hacker News post · 214 GitHub stars · View on GitHub

Hacker News discussions

• Dakshina dataset: text in Latin and native scripts for 12 South Asian languages (1 points, 0 comments, by blopeur, 2020-06-28)