Datasets
DATASETMeta AI
3/5

CC100

Southern Betsimisaraka Malagasy(bzc)TextLMEast Africa
View Source

Dataset Info

Language
Southern Betsimisaraka Malagasy (bzc)
Modality
Text
Domain
Web crawl
Size
100B+
Institution
Meta AI
Last Updated
19 May 2026

License & Access

SPDX identifierCC-BY

Open — attribution required; commercial use allowed.

RedistributionYes

PII RISK

Medium risk

Full Record

28 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (25/27)

iso code
bzc
Dataset name
CC100
Modality
Text
Type
dataset
Link
https://data.statmt.org/cc-100/
NLP Task
LM
Domain
Web crawl
Data Format
Not stated
Size Metric
Tokens
Size Value
100B+
License
CC-BY
Open Access
Open
Source Repository
Meta AI
Year Published
2020
Creator/Author(s)
Meta AI
Funder/Partner
Meta
Dialect Coverage
Mixed
Gender Balance
Not stated
Speaker Count
—
Annotation Type
Auto
Status
Active
Has Datasheet
Yes
PII Risk
Medium
Consent Verified
No
Verified By
Gideon
Date Indexed
2026-05-19
Notes / Flags
Web corpus slice

Quality (DQI) (2/12)

Datasheet Fields Completed
Not stated
SPDX License ID
Not stated
Redistribution Allowed?
Yes
Content Hash
Not stated
Submitted By
Not stated
Fetch Date
2026-05-19
Last Updated Date
Not stated
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

3/5
Data Coverage53%
Model Availability100%
Benchmarks0%
Documentation94%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
19 May 2026
Content Hash
—

Audit Log

Record indexed from Meta AI

19 May 2026

Source status: Active

19 May 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesAfrikaans(afr)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesAmharic(amh)TextLM
OTOther
Open26 May 2026
dataset

CC100

Web-mined corpus inclusion

28 languagesBassossi(bsi)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web corpus slice

28 languagesBassa-Kontagora(bsr)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web corpus slice

28 languagesBongili(bui)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web slice corpus

28 languagesBelanda Bor(bxb)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web corpus slice

28 languagesBozo, Kelengaxo(bzx)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web corpus slice

28 languagesCinda-Regi(cdr)TextLM
MEMeta AI
Open19 May 2026
dataset

CC100

Web-scraped corpus slice

28 languagesChala(cll)TextLM
MEMeta AI
Open20 May 2026
dataset

CC100

Web corpus slice

28 languagesForro Creole(cri)TextLM
MEMeta AI
Open20 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesHausa(hau)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesIgbo(ibo)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesLingala(lin)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesLuganda(lug)TextLM
OTOther
Open26 May 2026
dataset

CC-100 – Pedi

CC-100 monolingual web text for Pedi (ns.txt.xz, ~2 MB xz), recreating XLM-R's training data from 2018 CommonCrawl snapshots via CC-Net. Download: https://da…

28 languagesNorthern Sotho(nso)TextLM
STStatMT
Open27 Oct 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSomali(som)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSwazi(ssw)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesSwahili(swa)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesTswana(tsn)TextLM
OTOther
Open26 May 2026
dataset

Cc100

Parsed from Lanfrica name: cc100. Raw license: .

28 languagesWolof(wol)TextLM
OTOther
Open26 May 2026

Related Datasets