DATASETHugging Face

5/5

FineWeb-2

Gun(guw)TextLMWest Africa

View Source

Dataset Info

Language

Gun (guw)

Modality

Text

Domain

General

Size

n>1T n (samples)

Institution

HuggingFace FW

Last Updated

26 Jun 2026

License & Access

SPDX identifierodc-by

Licensed under odc-by. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

32 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (23/27)

iso code: guw
Dataset name: FineWeb-2
Modality: Text
Type: dataset
Link: https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
NLP Task: LM
Domain: General
Data Format: csv, parquetderivedHugging Face card: file formats
Size Metric: Tokens
Size Value: n>1T n (samples)
License: odc-by
Open Access: Open
Source Repository: Hugging Face
Year Published: 2024
Creator/Author(s): HuggingFace FW
Funder/Partner: Other
Dialect Coverage: Standard
Gender Balance: No
Speaker Count: Not stated
Annotation Type: Automatic
Status: Active
Has Datasheet: No
PII Risk: Not stated
Consent Verified: Not stated
Verified By: Not stated
Date Indexed: 2026-06-26
Notes / Flags: Large multilingual web crawl corpus with Gun coverage

Quality (DQI) (7/12)

Datasheet Fields Completed: Not stated
SPDX License ID: ODC-BY-1.0
Redistribution Allowed?: Yes
Content Hash: af9c13333eb981300149d5ca60a8e9d659b276b9derivedHugging Face card: commit sha
Submitted By: hf_data pipeline (automated)
Fetch Date: 2026-06-26
Last Updated Date: 2025-10-27derivedHugging Face card: lastModified
Annotation Guidelines Available?: Not stated
IAA Score: Not stated
Cleaning Notes: We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages. As such, we had to extensively ablate on di…derivedHugging Face card: "### Data Filtering 🧹 We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages."
Benchmark Exists?: Not stated
Benchmark Citation: Not stated

Representativeness (DRI) (2/7)

Gender Distribution: Not stated
Region Coverage: Not stated
Region Distribution: Not stated
Age Range Coverage: Not stated
Register: Written
Marginalized Group Note: Not stated
Demographic Fields Reported Count: 0

Readiness Score Breakdown

5/5

Data Coverage96%

Model Availability100%

Benchmarks100%

Documentation71%

Recency100%

Representativeness

Gender Balance

Regional Distribution

Dialect Coverage

Inclusivity

Provenance

Source URL

https://huggingface.co/datasets/HuggingFaceFW/fineweb-2

Fetch Timestamp

26 Jun 2026

Content Hash

af9c13333eb981300149d5ca60a8e9d659b276b9

Audit Log

Record indexed from Hugging Face

26 Jun 2026

Source status: Active

26 Jun 2026

Other Copies

The same resource, also published at these locations. It is counted once.

dataset

fineweb-2

text-generation · NLP domain · caoyuji

517 languages2 copiesGun(guw)Nlptext-generation

HUHugging Face

Open27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbé(aba)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Large-scale multilingual web text corpus tagged for Abidji (abi). 13 DS returned: 8 included, 5 excluded (KefranAbg/finepdfs fork of finepdfs; caoyuji/finewe…

517 languages2 copiesAbidji(abi)TextLM

HUHugging Face

Open24 Jul 2026

dataset