Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
Record indexed from Hugging Face
11 May 2026
Source status: Active
11 May 2026
The same resource, also published at these locations. It is counted once.
Data format: parquet
text2text-generation, translation · NLP (Health, Social Media) domain · meer3305
Parsed from Lanfrica name: the-flores-200-evaluation-benchmark-for-low-resource-and-multilingual-machine-translation.
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
Data format: parquet
Data format: parquet
Moroccan Arabic in 200-language MT benchmark
Data format: parquet
Data format: parquet
997 dev + 1,012 devtest sentences; human-translated from English; backbone of NLLB MT evaluation; Nature 2024 doi:10.1038/s41586-024-07335-x
"Multilingual MT evaluation corpus includes Bemba"
"Language code bez represented in FLORES-200"
Bari partially covered in FLORES under Nuer/Bari cluster; verify nus_Latn
Chokwe (cjk_Latn) in 200-language MT benchmark
Guinea-Bissau Creole (cpp_Latn) in 200-language MT benchmark
FLORES-200 parallel MT evaluation corpus includes Southwestern Dinka (dik_Latn). 3001 sentences, dev/devtest splits. First large-scale MT eval coverage for d…
No Language Left Behind seed data with dyu coverage for machine translation
Data format: parquet
Data format: parquet
Exact licence is CC-BY-SA-4.0, which is not available in the requested licence dropdown; dev and devtest total 2,009 sentences.
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Part of NCHLT project covering 11 SA languages
Annotated for POS, NER, phrase chunks; used in multiple benchmarks
Afrikaans via FLORES, Tatoeba, Wikipedia, OSCAR, Earthlings