Datasets
DATASETHugging Face
5/5

AfriBERTa Corpus (castorini)

Igbo(ibo)TextLMWest Africa
View Source

Dataset Info

Language
Igbo (ibo)
Modality
Text
Domain
General
Size
1M<n<10M
Institution
Castorini Research Group
Last Updated
30 Jun 2026

License & Access

SPDX identifierapache-2.0

Open — attribution required; commercial use allowed.

RedistributionYes

PII RISK

Unknown risk

Full Record

30 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (23/27)

iso code
ibo
Dataset name
AfriBERTa Corpus (castorini)
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/castorini/afriberta-corpus
NLP Task
LM
Domain
General
Data Format
json, zipderivedHugging Face card: file formats
Size Metric
Files
Size Value
1M<n<10MderivedHugging Face card: size_categories
License
apache-2.0
Open Access
Open
Source Repository
Hugging Face
Year Published
2022
Creator/Author(s)
Castorini Research Group
Funder/Partner
Other
Dialect Coverage
Standard
Gender Balance
No
Speaker Count
Not stated
Annotation Type
Not stated
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Igbo + 10 other African languages
Verified By
Not stated
Date Indexed
2026-06-30
Notes / Flags
Pretraining corpus for AfriBERTa; 11 African languages including Igbo; web-crawled text

Quality (DQI) (6/12)

Datasheet Fields Completed
Not stated
SPDX License ID
Apache-2.0
Redistribution Allowed?
Yes
Content Hash
d83da9653ef2a5f823c3693a28018e3009464522derivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-06-30
Last Updated Date
2022-10-19derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

5/5
Data Coverage100%
Model Availability100%
Benchmarks100%
Documentation74%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
30 Jun 2026
Content Hash
d83da9653ef2a5f823c3693a28018e3009464522

Audit Log

Record indexed from Hugging Face

30 Jun 2026

Source status: Active

30 Jun 2026

Other Copies

The same resource, also published at these locations. It is counted once.

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesAmharic(amh)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

AfriBERTa Corpus - Oromo

Corpus includes Oromo and is mostly collected from BBC News with some Common Crawl content; verify gaz mapping.

12 languages2 copiesWest Central Oromo(gaz)TextLM
HUHugging Face
Open3 Jun 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesHausa(hau)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesKinyarwanda(kin)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

AfriBERTa Corpus - Nigerian Pidgin

Nigerian Pidgin (pcm) included in AfriBERTa pretraining corpus. Sourced from BBC News Pidgin (bbcpidgin.com), a major news source that publishes daily news e…

12 languages2 copiesNigerian Pidgin(pcm)TextLM
HUHugging Face
Open11 Jun 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesKirundi(run)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesSomali(som)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesSwahili(swa)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesTigrinya(tir)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesYoruba(yor)Texttext-generation
HUHugging Face
Open27 Oct 2026

Related Datasets