Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
Record indexed from Hugging Face
5 Jun 2026
Source status: Active
5 Jun 2026
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
Data format: parquet
Used in 200-language MT benchmark
Data format: parquet
Moroccan Arabic in 200-language MT benchmark
Data format: parquet
Data format: parquet
997 dev + 1,012 devtest sentences; human-translated from English; backbone of NLLB MT evaluation; Nature 2024 doi:10.1038/s41586-024-07335-x
"Multilingual MT evaluation corpus includes Bemba"
Bari partially covered in FLORES under Nuer/Bari cluster; verify nus_Latn
Chokwe (cjk_Latn) in 200-language MT benchmark
Guinea-Bissau Creole (cpp_Latn) in 200-language MT benchmark
FLORES-200 parallel MT evaluation corpus includes Southwestern Dinka (dik_Latn). 3001 sentences, dev/devtest splits. First large-scale MT eval coverage for d…
No Language Left Behind seed data with dyu coverage for machine translation
Data format: parquet
Data format: parquet
Exact licence is CC-BY-SA-4.0, which is not available in the requested licence dropdown; dev and devtest total 2,009 sentences.
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
"Check dataset configuration for bez"
"Potential Bena coverage through Masakhane ecosystem"
"Verify bez language availability within OPUS collections"