Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
Record indexed from Hugging Face
27 Oct 2026
Source status: Active
27 Oct 2026
The same resource, also published at these locations. It is counted once.
Data format: parquet
Data format: parquet
Parsed from Lanfrica name: the-aya-dataset.
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Multilingual instruction tuning dataset with Igbo from Cohere
Multilingual instruction-following dataset including Malagasy (mlg). Felladrin/ChatML fork, janavivekariya forks excluded.
Data format: parquet
Canonical human-curated Aya instruction dataset, includes Chichewa. Excluded as forks/re-uploads: Felladrin/ChatML-aya_dataset (ChatML reformat), janavivekar…
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Data format: parquet
Shona (sna / chiShona) included in MasakhaNER 2.0, a 20-language African NER benchmark. F1=96.5 (highest in the benchmark). Entities: DATE, LOC, ORG, PER. Us…
Shona (sna) TTS from Meta MMS. ~15M speakers. Official language of Zimbabwe.
Shona (sna) covered in Meta MMS 1B multilingual ASR model (1107+ languages).