Datasets
DATASETHugging Face
4/5

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Abidji(abi)TextLMWest Africa
View Source

Dataset Info

Language
Abidji (abi)
Modality
Text
Domain
General
Size
n>1T n (samples)
Institution
HuggingFace FineWeb Team
Last Updated
24 Jul 2026

License & Access

SPDX identifierODC-BY

Licensed under ODC-BY. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

32 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (23/27)

iso code
abi
Dataset name
FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
NLP Task
LM
Domain
General
Data Format
csv, parquetderivedHugging Face card: file formats
Size Metric
n (samples)
Size Value
n>1T n (samples)
License
ODC-BY
Open Access
Open
Source Repository
Hugging Face
Year Published
2024
Creator/Author(s)
HuggingFace FineWeb Team
Funder/Partner
HuggingFace
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Automatic
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Emmanuel
Date Indexed
2026-07-24
Notes / Flags
Large-scale multilingual web text corpus tagged for Abidji (abi). 13 DS returned: 8 included, 5 excluded (KefranAbg/finepdfs fork of finepdfs; caoyuji/fineweb-2…

Quality (DQI) (7/12)

Datasheet Fields Completed
Not stated
SPDX License ID
ODC-BY-1.0
Redistribution Allowed?
Yes
Content Hash
af9c13333eb981300149d5ca60a8e9d659b276b9derivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-07-24
Last Updated Date
2025-10-27derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages. As such, we had to extensively ablate on di…derivedHugging Face card: "### Data Filtering 🧹 We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages."
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (2/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Written
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

4/5
Data Coverage71%
Model Availability100%
Benchmarks100%
Documentation76%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Source URL
https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
Fetch Timestamp
24 Jul 2026
Content Hash
af9c13333eb981300149d5ca60a8e9d659b276b9

Audit Log

Record indexed from Hugging Face

24 Jul 2026

Source status: Active

24 Jul 2026

Other Copies

The same resource, also published at these locations. It is counted once.

dataset

fineweb-2

text-generation · NLP domain · caoyuji

517 languages2 copiesAbidji(abi)Nlptext-generation
HUHugging Face
Open27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbé(aba)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbua(abn)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesKyode(acd)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAcholi(ach)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDangme(ada)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdele(ade)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdhola(adh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdjoukrou(adj)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesTunisian Arabic(aeb)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAfrikaans(afr)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAhanta(aha)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdja(ajg)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesSiwu(akp)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAlur(alz)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesHamer(amf)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAmharic(amh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAndoni(ann)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDenya(anv)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAnyin(any)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAlgerian Arabic(arq)Tabulartext-generation
HUHugging Face
Open27 Oct 2026

Related Datasets

dataset

FinePDFs Large-Scale Web Text Corpus (HuggingFaceFW)

Large-scale PDF-based web text corpus tagged for Abidji (abi). KefranAbg fork excluded.

511 languages2 copiesAbidji(abi)TextLM
HUHugging Face
Open24 Jul 2026
dataset

Language Tags Reference (lbourdois)

Multilingual language tag metadata dataset. Contains abi (Abidji) as one of many language codes.

2,228 languagesAbidji(abi)TextOther
HUHugging Face
Open24 Jul 2026
dataset

MMS ULAB Speech Corpus v2

Multilingual speech corpus from Meta's MMS project including Abidji (abi). amine-khelif and sundram1996 forks excluded.

1,433 languages3 copiesAbidji(abi)SpeechASR
HUHugging Face
Restricted24 Jul 2026