FinePDFs-Edu Educational Web Text (HuggingFaceFW)

Dagbani(dag)TextLMWest Africa

View Source

Dataset Info

Language

Dagbani (dag)

Modality

Text

Domain

Education

Size

n>1T n (samples)

Institution

HuggingFace FineWeb Team

Last Updated

27 Oct 2026

License & Access

SPDX identifierODC-BY

Licensed under ODC-BY. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

29 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (21/27)

iso code: dag
Dataset name: FinePDFs-Edu Educational Web Text (HuggingFaceFW)
Modality: Text
Type: dataset
Link: https://huggingface.co/datasets/HuggingFaceFW/finepdfs-edu
NLP Task: LM
Domain: Education
Data Format: parquet
Size Metric: n (samples)
Size Value: n>1T n (samples)
License: ODC-BY
Open Access: Open
Source Repository: Hugging Face
Year Published: 2024
Creator/Author(s): HuggingFace FineWeb Team
Funder/Partner: HuggingFace
Dialect Coverage: Standard
Gender Balance: Not stated
Speaker Count: Not stated
Annotation Type: Not stated
Status: Activederivedupdated or published within 3 years
Has Datasheet: YesderivedHugging Face card: README with a description of 300+ characters
PII Risk: Not stated
Consent Verified: Not stated
Verified By: Not stated
Date Indexed: 2026-10-27
Notes / Flags: Data format: parquet

Quality (DQI) (7/12)

Datasheet Fields Completed: Not stated
SPDX License ID: ODC-BY-1.0
Redistribution Allowed?: Yes
Content Hash: 9cfabe2127faca99b3d5c4dc6d1fcb397399ebdederivedHugging Face card: commit sha
Submitted By: hf_data pipeline (automated)
Fetch Date: 2026-10-27
Last Updated Date: 2025-11-11derivedHugging Face card: lastModified
Annotation Guidelines Available?: Not stated
IAA Score: Not stated
Cleaning Notes: We then built 📚 FinePDFs-Edu by filtering out 90% of samples with lowest edu score for each language. Our ablation demonstrated that this refined dataset surpa…derivedHugging Face card: "### Filtering and results We then built 📚 FinePDFs-Edu by filtering out 90% of samples with lowest edu score for each language."
Benchmark Exists?: Not stated
Benchmark Citation: Not stated