Datasets
DATASETHugging Face
5/5

finepdfs-edu

Nigerian Pidgin(pcm)Tabulartext-generationWest Africa
View Source

Dataset Info

Language
Nigerian Pidgin (pcm)
Modality
Tabular
Domain
NLP (Education)
Size
n>1T n (samples)
Institution
HuggingFaceFW
Last Updated
27 Oct 2026

License & Access

SPDX identifierodc-by

Licensed under odc-by. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

28 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (20/27)

iso code
pcm
Dataset name
finepdfs-edu
Modality
Tabular
Type
dataset
Link
https://huggingface.co/datasets/HuggingFaceFW/finepdfs-edu
NLP Task
text-generation
Domain
NLP (Education)
Data Format
parquet
Size Metric
n (samples)
Size Value
n>1T n (samples)
License
odc-by
Open Access
Open
Source Repository
Hugging Face
Year Published
2025
Creator/Author(s)
HuggingFaceFW
Funder/Partner
Meta
Dialect Coverage
Not stated
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Not stated
Status
Activederivedupdated or published within 3 years
Has Datasheet
YesderivedHugging Face card: README with a description of 300+ characters
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Not stated
Date Indexed
2026-10-27
Notes / Flags
Data format: parquet

Quality (DQI) (7/12)

Datasheet Fields Completed
Not stated
SPDX License ID
ODC-BY-1.0
Redistribution Allowed?
Yes
Content Hash
9cfabe2127faca99b3d5c4dc6d1fcb397399ebdederivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-10-27
Last Updated Date
2025-11-11derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
We then built 📚 FinePDFs-Edu by filtering out 90% of samples with lowest edu score for each language. Our ablation demonstrated that this refined dataset surpa…derivedHugging Face card: "### Filtering and results We then built 📚 FinePDFs-Edu by filtering out 90% of samples with lowest edu score for each language."
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

5/5
Data Coverage100%
Model Availability100%
Benchmarks100%
Documentation77%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
27 Oct 2026
Content Hash
9cfabe2127faca99b3d5c4dc6d1fcb397399ebde

Audit Log

Record indexed from Hugging Face

27 Oct 2026

Source status: Active

27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

Related Datasets