Datasets
DATASETHugging Face
5/5

afriberta-corpus

Swahili(swa)Texttext-generationEast Africa
View Source

Dataset Info

Language
Swahili (swa)
Modality
Text
Domain
NLP (News)
Size
1M<n<10M
Institution
castorini
Last Updated
27 Oct 2026

License & Access

SPDX identifierapache-2.0

Open — attribution required; commercial use allowed.

RedistributionYes

PII RISK

Unknown risk

Full Record

24 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (17/27)

iso code
swa
Dataset name
afriberta-corpus
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/castorini/afriberta-corpus
NLP Task
text-generation
Domain
NLP (News)
Data Format
json, zipderivedHugging Face card: file formats
Size Metric
n (samples)
Size Value
1M<n<10MderivedHugging Face card: size_categories
License
apache-2.0
Open Access
Open
Source Repository
Hugging Face
Year Published
2022
Creator/Author(s)
castorini
Funder/Partner
Not stated
Dialect Coverage
Not stated
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Not stated
Status
Not stated
Has Datasheet
NoderivedHugging Face card: no README or a description under 300 characters
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Not stated
Date Indexed
2026-10-27
Notes / Flags
Not stated

Quality (DQI) (6/12)

Datasheet Fields Completed
Not stated
SPDX License ID
Apache-2.0
Redistribution Allowed?
Yes
Content Hash
d83da9653ef2a5f823c3693a28018e3009464522derivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-10-27
Last Updated Date
2022-10-19derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

5/5
Data Coverage100%
Model Availability100%
Benchmarks100%
Documentation79%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
27 Oct 2026
Content Hash
d83da9653ef2a5f823c3693a28018e3009464522

Audit Log

Record indexed from Hugging Face

27 Oct 2026

Source status: Unknown

27 Oct 2026

Other Copies

The same resource, also published at these locations. It is counted once.

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesAmharic(amh)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

AfriBERTa Corpus - Oromo

Corpus includes Oromo and is mostly collected from BBC News with some Common Crawl content; verify gaz mapping.

12 languages2 copiesWest Central Oromo(gaz)TextLM
HUHugging Face
Open3 Jun 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesHausa(hau)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

AfriBERTa Corpus (castorini)

Pretraining corpus for AfriBERTa; 11 African languages including Igbo; web-crawled text

12 languages2 copiesIgbo(ibo)TextLM
HUHugging Face
Open30 Jun 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesKinyarwanda(kin)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

AfriBERTa Corpus - Nigerian Pidgin

Nigerian Pidgin (pcm) included in AfriBERTa pretraining corpus. Sourced from BBC News Pidgin (bbcpidgin.com), a major news source that publishes daily news e…

12 languages2 copiesNigerian Pidgin(pcm)TextLM
HUHugging Face
Open11 Jun 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesKirundi(run)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesSomali(som)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesTigrinya(tir)Texttext-generation
HUHugging Face
Open27 Oct 2026
dataset

afriberta-corpus

text-generation · NLP (News) domain · castorini

12 languages2 copiesYoruba(yor)Texttext-generation
HUHugging Face
Open27 Oct 2026

Related Datasets