Datasets
DATASETHugging Face
4/5

finepdfs

Berom(bom)Tabulartext-generationWest Africa
View Source

Dataset Info

Language
Berom (bom)
Modality
Tabular
Domain
NLP (Legal)
Size
n>1T n (samples)
Institution
KefranAbg
Last Updated
27 Oct 2026

License & Access

SPDX identifierodc-by

Licensed under odc-by. Review the source terms before use.

RedistributionYes

PII RISK

Unknown risk

Full Record

29 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (21/27)

iso code
bom
Dataset name
finepdfs
Modality
Tabular
Type
dataset
Link
https://huggingface.co/datasets/KefranAbg/finepdfs
NLP Task
text-generation
Domain
NLP (Legal)
Data Format
parquet
Size Metric
n (samples)
Size Value
n>1T n (samples)
License
odc-by
Open Access
Open
Source Repository
Hugging Face
Year Published
2025
Creator/Author(s)
KefranAbg
Funder/Partner
Not stated
Dialect Coverage
Code-switchedderivedHugging Face card: "Code-Switching Unlike in typical HTML dataset, in 📄 FinePDFs many documents contain code-switching—the use of multiple languages within a single document."
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Semi-Auto
Status
Activederivedupdated or published within 3 years
Has Datasheet
YesderivedHugging Face card: README with a description of 300+ characters
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Not stated
Date Indexed
2026-10-27
Notes / Flags
Data format: parquet

Quality (DQI) (7/12)

Datasheet Fields Completed
Not stated
SPDX License ID
ODC-BY-1.0
Redistribution Allowed?
Yes
Content Hash
f2479d369bc7f3c099cf1f740afc49b2c4e28a26derivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-10-27
Last Updated Date
2025-12-03derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
We do not apply any heuristic-based filters. Our only filtering is model-based and applied to the engLatn subset. For this, we follow a similar approach to Fine…derivedHugging Face card: "### Data Filtering 🧹 We do not apply any heuristic-based filters."
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

4/5
Data Coverage80%
Model Availability100%
Benchmarks100%
Documentation69%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
27 Oct 2026
Content Hash
f2479d369bc7f3c099cf1f740afc49b2c4e28a26

Audit Log

Record indexed from Hugging Face

27 Oct 2026

Source status: Active

27 Oct 2026

Other Copies

This is a copy of the resource below, which the platform counts and shows in search.

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

finepdfs

Data format: parquet

511 languages2 copiesAbé(aba)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

FinePDFs Large-Scale Web Text Corpus (HuggingFaceFW)

Large-scale PDF-based web text corpus tagged for Abidji (abi). KefranAbg fork excluded.

511 languages2 copiesAbidji(abi)TextLM
HUHugging Face
Open24 Jul 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAbua(abn)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesKyode(acd)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAcholi(ach)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesDangme(ada)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAdele(ade)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAdhola(adh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAdjoukrou(adj)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesTunisian Arabic(aeb)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAfrikaans(afr)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAhanta(aha)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAdja(ajg)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesSiwu(akp)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAlur(alz)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesHamer(amf)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAmharic(amh)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAndoni(ann)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesDenya(anv)Tabulartext-generation
HUHugging Face
Open27 Oct 2026
dataset

finepdfs

Data format: parquet

511 languages2 copiesAnyin(any)Tabulartext-generation
HUHugging Face
Open27 Oct 2026

Related Datasets