Datasets
DATASETHugging Face
5/5

The Aya Dataset

Shona(sna)TextMTEast Africa
View Source

Dataset Info

Language
Shona (sna)
Modality
Text
Domain
General
Size
205568
Institution
Hugging Face
Last Updated
26 May 2026

License & Access

SPDX identifierapache-2.0

Open — attribution required; commercial use allowed.

RedistributionAllowed

PII RISK

Low risk

Full Record

28 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (23/27)

iso code
sna
Dataset name
The Aya Dataset
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/CohereForAI/aya_dataset
NLP Task
MT
Domain
General
Data Format
parquetderivedHugging Face card: file formats
Size Metric
Examples
Size Value
205568derivedHugging Face card: dataset_info split sizes
License
apache-2.0derivedHugging Face card: license
Open Access
Open
Source Repository
Hugging Face
Year Published
2024derivedHugging Face card: createdAt
Creator/Author(s)
Not stated
Funder/Partner
Other
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
HumanderivedHugging Face card: annotations_creators
Status
Active
Has Datasheet
No
PII Risk
LowderivedHugging Face card: "2. Demographics Data: Anonymized information for each annotator."
Consent Verified
Not stated
Verified By
Lanfrica Pipeline
Date Indexed
2026-05-26
Notes / Flags
Parsed from Lanfrica name: the-aya-dataset.

Quality (DQI) (4/12)

Datasheet Fields Completed
Not stated
SPDX License ID
Not stated
Redistribution Allowed?
Not stated
Content Hash
f9ea04583f02a8f86404ff6c58bf75fe637df8a2derivedHugging Face card: commit sha
Submitted By
LanAfrica pipeline (automated)
Fetch Date
2026-05-26
Last Updated Date
2025-04-15derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

5/5
Data Coverage100%
Model Availability100%
Benchmarks100%
Documentation87%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
26 May 2026
Content Hash
f9ea04583f02a8f86404ff6c58bf75fe637df8a2

Audit Log

Record indexed from Hugging Face

26 May 2026

Source status: Active

26 May 2026

Other Copies

This is a copy of the resource below, which the platform counts and shows in search.

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

aya_dataset

Data format: parquet

15 languages4 copiesAmharic(amh)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesMoroccan Arabic (Darija)(ary)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesEgyptian Arabic(arz)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesHausa(hau)Textother
HUHugging Face
Open27 Oct 2026
dataset

Aya Dataset (CohereLabs)

Multilingual instruction tuning dataset with Igbo from Cohere

15 languages4 copiesIgbo(ibo)TextLM
HUHugging Face
Open30 Jun 2026
dataset

Aya Dataset (CohereLabs)

Multilingual instruction-following dataset including Malagasy (mlg). Felladrin/ChatML fork, janavivekariya forks excluded.

15 languages4 copiesMalagasy(mlg)Textother
HUHugging Face
Open17 Jul 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesNorthern Sotho(nso)Textother
HUHugging Face
Open27 Oct 2026
dataset

Aya Dataset

Canonical human-curated Aya instruction dataset, includes Chichewa. Excluded as forks/re-uploads: Felladrin/ChatML-aya_dataset (ChatML reformat), janavivekar…

15 languages4 copiesChewa(nya)TextInstruction-Tuning
HUHugging Face
Open3 Aug 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesSomali(som)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesSwahili(swa)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesWolof(wol)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesXhosa(xho)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesYoruba(yor)Textother
HUHugging Face
Open27 Oct 2026
dataset

aya_dataset

Data format: parquet

15 languages4 copiesZulu(zul)Textother
HUHugging Face
Open27 Oct 2026

Related Datasets