Datasets
DATASETHugging Face
5/5

fineweb-2

Chopi(cce)Nlptext-generationEast Africa
View Source

Dataset Info

Language
Chopi (cce)
Modality
Nlp
Domain
NLP
Size
n>1T n (samples)
Institution
caoyuji
Last Updated
27 Oct 2026

License & Access

SPDX identifierodc-by

Licensed under odc-by. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

29 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (20/27)

iso code
cce
Dataset name
fineweb-2
Modality
Nlp
Type
dataset
Link
https://huggingface.co/datasets/caoyuji/fineweb-2
NLP Task
text-generation
Domain
NLP
Data Format
csv, parquetderivedHugging Face card: file formats
Size Metric
n (samples)
Size Value
n>1T n (samples)
License
odc-by
Open Access
Open
Source Repository
Hugging Face
Year Published
2025
Creator/Author(s)
caoyuji
Funder/Partner
Google
Dialect Coverage
Not stated
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Automatic
Status
Activederivedupdated or published within 3 years
Has Datasheet
YesderivedHugging Face card: README with a description of 300+ characters
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Not stated
Date Indexed
2026-10-27
Notes / Flags
Not stated

Quality (DQI) (7/12)

Datasheet Fields Completed
Not stated
SPDX License ID
ODC-BY-1.0
Redistribution Allowed?
Yes
Content Hash
4057e43d8bcc1ed997df3bc04c24de9cfc38c3bfderivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-10-27
Last Updated Date
2025-12-08derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages. As such, we had to extensively ablate on di…derivedHugging Face card: "### Data Filtering 🧹 We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages."
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (2/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Written
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

5/5
Data Coverage81%
Model Availability100%
Benchmarks100%
Documentation85%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Source URL
https://huggingface.co/datasets/caoyuji/fineweb-2
Fetch Timestamp
27 Oct 2026
Content Hash
4057e43d8bcc1ed997df3bc04c24de9cfc38c3bf

Audit Log

Record indexed from Hugging Face

27 Oct 2026

Source status: Active

27 Oct 2026

Other Copies

This is a copy of the resource below, which the platform counts and shows in search.

dataset

FineWeb-2 — multilingual web corpus (HuggingFaceFW/fineweb-2), cce_Latn subset (615 train + 8 test)

CONFIRMED: FineWeb-2 lists subset 'cce_Latn' with train 615 + test 8 rows (verified on the dataset page). Deduplicated, filtered Chopi web text from 96 Commo…

517 languages2 copiesChopi(cce)TextLM
HUHugging Face
Open2 Jul 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbé(aba)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Large-scale multilingual web text corpus tagged for Abidji (abi). 13 DS returned: 8 included, 5 excluded (KefranAbg/finepdfs fork of finepdfs; caoyuji/finewe…

517 languages2 copiesAbidji(abi)TextLM
HUHugging Face
Open24 Jul 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbua(abn)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesKyode(acd)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAcholi(ach)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDangme(ada)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdele(ade)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdhola(adh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdjoukrou(adj)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesTunisian Arabic(aeb)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAfrikaans(afr)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAhanta(aha)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdja(ajg)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesSiwu(akp)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAlur(alz)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesHamer(amf)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAmharic(amh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAndoni(ann)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDenya(anv)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAnyin(any)Tabulartext-generation
HUHugging Face
Open27 Oct 2026

Related Datasets

dataset

English-Chopi parallel corpus (michsethowusu/english-chopi_sentence-pairs_mt560), 17,935 pairs

CONFIRMED headline resource. 17,935 English<->Chopi parallel sentence pairs (verified: columns eng/cce, 17.9k rows, CC-BY-4.0), derived from the OPUS MT560 c…

Chopi(cce)TextMT
HUHugging Face
Open2 Jul 2026
dataset

FineWeb-2 — multilingual web corpus (HuggingFaceFW/fineweb-2), cce_Latn subset (615 train + 8 test)

CONFIRMED: FineWeb-2 lists subset 'cce_Latn' with train 615 + test 8 rows (verified on the dataset page). Deduplicated, filtered Chopi web text from 96 Commo…

517 languages2 copiesChopi(cce)TextLM
HUHugging Face
Open2 Jul 2026
dataset

DCAD-2000 — Multilingual Common-Crawl corpus (openbmb/DCAD-2000), cce_Latn subset

VERY LIKELY (verify exact count). DCAD-2000 is built partly FROM FineWeb/Fineweb-2 + MaLA + fresh Common Crawl; since Chopi has a confirmed FineWeb-2 cce_Lat…

577 languagesChopi(cce)TextLM
HUHugging Face
Open2 Jul 2026