Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
Record indexed from Hugging Face
17 Jul 2026
Source status: Active
17 Jul 2026
The same resource, also published at these locations. It is counted once.
Data format: parquet
Data format: parquet
Parsed from Lanfrica name: the-aya-dataset.
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Multilingual instruction tuning dataset with Igbo from Cohere
Data format: parquet
Canonical human-curated Aya instruction dataset, includes Chichewa. Excluded as forks/re-uploads: Felladrin/ChatML-aya_dataset (ChatML reformat), janavivekar…
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Malagasy (mlg/mg) included in OPUS-100, a massively multilingual MT corpus (100 languages, 1M sentence pairs per language pair). Used to train Helsinki-NLP O…
Linguistic study of Kotoko Chadic languages in Nigeria, Cameroon and Chad including Mpade (mpi). Glottolog ref 103766.
Languages of the Lake Chad basin including Mpade (mpi). Glottolog ref 117003.