DATASETStatMT

5/5

CC-100 – Pedi

Northern Sotho(nso)TextLMSouthern Africa

View Source

Dataset Info

Language

Northern Sotho (nso)

Modality

Text

Domain

General

Size

—

Institution

Conneau et al. (XLM-R); Wenzek et al. (CC-Net)

Last Updated

27 Oct 2026

License & Access

SPDX identifierUnknown

License unknown — use with caution until an SPDX identifier is confirmed.

RedistributionAllowed

PII RISK

Unknown risk

Full Record

18 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (14/27)

iso code: nso
Dataset name: CC-100 – Pedi
Modality: Text
Type: dataset
Link: https://data.statmt.org/cc-100/
NLP Task: LM
Domain: General
Data Format: Not stated
Size Metric: Not stated
Size Value: Not stated
License: Not stated
Open Access: Open
Source Repository: StatMT
Year Published: 2020
Creator/Author(s): Conneau et al. (XLM-R); Wenzek et al. (CC-Net)
Funder/Partner: Not stated
Dialect Coverage: Not stated
Gender Balance: Not stated
Speaker Count: Not stated
Annotation Type: Not stated
Status: Active
Has Datasheet: Not stated
PII Risk: Not stated
Consent Verified: Not stated
Verified By: Not stated
Date Indexed: 2026-10-27
Notes / Flags: CC-100 monolingual web text for Pedi (ns.txt.xz, ~2 MB xz), recreating XLM-R's training data from 2018 CommonCrawl snapshots via CC-Net. Download: https://data.…

Quality (DQI) (3/12)

Datasheet Fields Completed: Not stated
SPDX License ID: Not stated
Redistribution Allowed?: Not stated
Content Hash: Not stated
Submitted By: StatMT connector (automated)
Fetch Date: 2026-10-27
Last Updated Date: 2020-10-20
Annotation Guidelines Available?: Not stated
IAA Score: Not stated
Cleaning Notes: Not stated
Benchmark Exists?: Not stated
Benchmark Citation: Not stated

Representativeness (DRI) (1/7)

Gender Distribution: Not stated
Region Coverage: Not stated
Region Distribution: Not stated
Age Range Coverage: Not stated
Register: Not stated
Marginalized Group Note: Not stated
Demographic Fields Reported Count: 0

Readiness Score Breakdown

5/5

Data Coverage100%

Model Availability100%

Benchmarks100%

Documentation74%

Recency100%

Representativeness

Gender Balance

Regional Distribution

Dialect Coverage

Inclusivity

Provenance

Source URL

https://data.statmt.org/cc-100/

Fetch Timestamp

27 Oct 2026

Content Hash

—

Audit Log

Record indexed from StatMT

27 Oct 2026

Source status: Active

27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesAfrikaans(afr)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesAmharic(amh)TextLM

OTOther

Open26 May 2026

dataset

CC100

Web-mined corpus inclusion

28 languagesBassossi(bsi)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web corpus slice

28 languagesBassa-Kontagora(bsr)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web corpus slice

28 languagesBongili(bui)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web slice corpus

28 languagesBelanda Bor(bxb)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web corpus slice

28 languagesSouthern Betsimisaraka Malagasy(bzc)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web corpus slice

28 languagesBozo, Kelengaxo(bzx)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web corpus slice

28 languagesCinda-Regi(cdr)TextLM

MEMeta AI

Open19 May 2026

dataset

CC100

Web-scraped corpus slice

28 languagesChala(cll)TextLM

MEMeta AI

Open20 May 2026

dataset

CC100

Web corpus slice

28 languagesForro Creole(cri)TextLM

MEMeta AI

Open20 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesHausa(hau)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesIgbo(ibo)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesLingala(lin)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesLuganda(lug)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSomali(som)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSwazi(ssw)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSwahili(swa)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesTswana(tsn)TextLM

OTOther

Open26 May 2026

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesWolof(wol)TextLM

OTOther

Open26 May 2026

Related Datasets

dataset

Lingua Libre pronunciation corpus - Northern Sotho

Word-level isolated pronunciations, not continuous speech. Counts from the lingualibre.org/gallery snapshot read 2026-07-24. Commons category pattern: https:…

81 languagesNorthern Sotho(nso)SpeechASR/TTS

OTOther (Lingua Libre / Wikime

Open24 Jul 2026

dataset

FLEURS

FLEURS subset nso_za. Row count approximate, read from the Hugging Face viewer 2026-07-24. Speech version of the FLoRes benchmark, 102 languages, read speech…

27 languages15 copiesNorthern Sotho(nso)SpeechGender data

HUHugging Face

Open24 Jul 2026

dataset

Common Voice Scripted Speech 26.0 - Northern Sotho

Northern Sotho(nso)SpeechASR

OTOther

Open—