DATASETHugging Face

4/5

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Mamara Senoufo(myk)TextLMWest Africa

View Source

Dataset Info

Language

Mamara Senoufo (myk)

Modality

Text

Domain

General

Size

n>1T n (samples)

Institution

HuggingFace FineWeb Team

Last Updated

20 Jul 2026

License & Access

SPDX identifierODC-BY

Licensed under ODC-BY. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

32 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (23/27)

iso code: myk
Dataset name: FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)
Modality: Text
Type: dataset
Link: https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
NLP Task: LM
Domain: General
Data Format: csv, parquetderivedHugging Face card: file formats
Size Metric: n (samples)
Size Value: n>1T n (samples)
License: ODC-BY
Open Access: Open
Source Repository: Hugging Face
Year Published: 2024
Creator/Author(s): HuggingFace FineWeb Team
Funder/Partner: HuggingFace
Dialect Coverage: Standard
Gender Balance: Not stated
Speaker Count: Not stated
Annotation Type: Automatic
Status: Active
Has Datasheet: No
PII Risk: Not stated
Consent Verified: Not stated
Verified By: Emmanuel
Date Indexed: 2026-07-20
Notes / Flags: Large-scale multilingual web text corpus tagged for Mamara Senoufo (myk). caoyuji fork excluded.

Quality (DQI) (7/12)

Datasheet Fields Completed: Not stated
SPDX License ID: ODC-BY-1.0
Redistribution Allowed?: Yes
Content Hash: af9c13333eb981300149d5ca60a8e9d659b276b9derivedHugging Face card: commit sha
Submitted By: hf_data pipeline (automated)
Fetch Date: 2026-07-20
Last Updated Date: 2025-10-27derivedHugging Face card: lastModified
Annotation Guidelines Available?: Not stated
IAA Score: Not stated
Cleaning Notes: We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages. As such, we had to extensively ablate on di…derivedHugging Face card: "### Data Filtering 🧹 We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages."
Benchmark Exists?: Not stated
Benchmark Citation: Not stated

Representativeness (DRI) (2/7)

Gender Distribution: Not stated
Region Coverage: Not stated
Region Distribution: Not stated
Age Range Coverage: Not stated
Register: Written
Marginalized Group Note: Not stated
Demographic Fields Reported Count: 0

Readiness Score Breakdown

4/5

Data Coverage87%

Model Availability100%

Benchmarks100%

Documentation60%

Recency100%

Representativeness

Gender Balance

Regional Distribution

Dialect Coverage

Inclusivity

Provenance

Source URL

https://huggingface.co/datasets/HuggingFaceFW/fineweb-2

Fetch Timestamp

20 Jul 2026

Content Hash

af9c13333eb981300149d5ca60a8e9d659b276b9

Audit Log

Record indexed from Hugging Face

20 Jul 2026

Source status: Active

20 Jul 2026

Other Copies

The same resource, also published at these locations. It is counted once.

dataset

fineweb-2

text-generation · NLP domain · caoyuji

517 languages2 copiesMamara Senoufo(myk)Nlptext-generation

HUHugging Face

Open27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbé(aba)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset