Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
Record indexed from Hugging Face
11 Jun 2026
Source status: Active
11 Jun 2026
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
Data format: parquet
Used in 200-language MT benchmark
Data format: parquet
Moroccan Arabic in 200-language MT benchmark
Data format: parquet
Data format: parquet
997 dev + 1,012 devtest sentences; human-translated from English; backbone of NLLB MT evaluation; Nature 2024 doi:10.1038/s41586-024-07335-x
"Multilingual MT evaluation corpus includes Bemba"
"Language code bez represented in FLORES-200"
Bari partially covered in FLORES under Nuer/Bari cluster; verify nus_Latn
Chokwe (cjk_Latn) in 200-language MT benchmark
Guinea-Bissau Creole (cpp_Latn) in 200-language MT benchmark
FLORES-200 parallel MT evaluation corpus includes Southwestern Dinka (dik_Latn). 3001 sentences, dev/devtest splits. First large-scale MT eval coverage for d…
No Language Left Behind seed data with dyu coverage for machine translation
Data format: parquet
Data format: parquet
Exact licence is CC-BY-SA-4.0, which is not available in the requested licence dropdown; dev and devtest total 2,009 sentences.
Data format: parquet
Data format: parquet
Data format: parquet
nicolingua-0005: 130,850 trilingual/bilingual parallel segments in N'Ko (nqo) + monolingual corpus with 3M+ N'Ko words. Sources include Quran translations, b…
6,193 N'Ko translations extending the NLLB-Seed corpus (parallel with 40 other languages). Human-translated. Part of nicolingua-0005. Can be used to fine-tun…
N'Ko Wikipedia-based NLP model with fastText embeddings, n-gram tokenizer, and Markov chain text generation. Trained on N'Ko Wikipedia (omarkamali/wikipedia-…