DATASETHugging Face

5/5

FineWeb-2 - multilingual web corpus (HuggingFaceFW/fineweb-2), dga_Latn subset

Southern Dagaare(dga)TextLMWest Africa

View Source

Dataset Info

Language

Southern Dagaare (dga)

Modality

Text

Domain

General

Size

n>1T n (samples)

Institution

Penedo, Guilherme; Kydlicek, Hynek et al. (HuggingFace); arXiv:2506.20920

Last Updated

2 Jul 2026

License & Access

SPDX identifierODC-BY-1.0

Licensed under ODC-BY-1.0. Review the source terms before use.

RedistributionYes

PII RISK

Low risk

Full Record

32 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (24/27)

iso code: dga
Dataset name: FineWeb-2 - multilingual web corpus (HuggingFaceFW/fineweb-2), dga_Latn subset
Modality: Text
Type: dataset
Link: https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
NLP Task: LM
Domain: General
Data Format: csv, parquetderivedHugging Face card: file formats
Size Metric: Files
Size Value: n>1T n (samples)
License: ODC-BY-1.0
Open Access: Open
Source Repository: Hugging Face
Year Published: 2024
Creator/Author(s): Penedo, Guilherme; Kydlicek, Hynek et al. (HuggingFace); arXiv:2506.20920
Funder/Partner: Other
Dialect Coverage: Standard
Gender Balance: Not stated
Speaker Count: Not stated
Annotation Type: Automatic
Status: Active
Has Datasheet: Yes
PII Risk: Low
Consent Verified: Not stated
Verified By: Agboola Blessing
Date Indexed: 2026-07-02
Notes / Flags: VERY LIKELY (verify). FineWeb-2 covers 1,868 language-script pairs via GlotLID. Southern Dagaare (~700k-1.3M speakers, language of instruction in Ghana, own Wik…

Quality (DQI) (6/12)

Datasheet Fields Completed: Not stated
SPDX License ID: Not stated
Redistribution Allowed?: Yes
Content Hash: af9c13333eb981300149d5ca60a8e9d659b276b9derivedHugging Face card: commit sha
Submitted By: hf_data pipeline (automated)
Fetch Date: 2026-07-02
Last Updated Date: 2025-10-27derivedHugging Face card: lastModified
Annotation Guidelines Available?: Not stated
IAA Score: Not stated
Cleaning Notes: We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages. As such, we had to extensively ablate on di…derivedHugging Face card: "### Data Filtering 🧹 We mostly kept the original 🍷 FineWeb set of filters, and do not create new filters targeting individual languages."
Benchmark Exists?: Not stated
Benchmark Citation: Not stated

Representativeness (DRI) (2/7)

Gender Distribution: Not stated
Region Coverage: Not stated
Region Distribution: Not stated
Age Range Coverage: Not stated
Register: Written
Marginalized Group Note: Not stated
Demographic Fields Reported Count: 0

Readiness Score Breakdown

5/5

Data Coverage100%

Model Availability100%

Benchmarks100%

Documentation71%

Recency100%

Representativeness

Gender Balance

Regional Distribution

Dialect Coverage

Inclusivity

Provenance

Source URL

https://huggingface.co/datasets/HuggingFaceFW/fineweb-2

Fetch Timestamp

2 Jul 2026

Content Hash

af9c13333eb981300149d5ca60a8e9d659b276b9

Audit Log

Record indexed from Hugging Face

2 Jul 2026

Source status: Active

2 Jul 2026

Other Copies

The same resource, also published at these locations. It is counted once.

dataset

fineweb-2

text-generation · NLP domain · caoyuji

517 languages2 copiesSouthern Dagaare(dga)Nlptext-generation

HUHugging Face

Open27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbé(aba)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Large-scale multilingual web text corpus tagged for Abidji (abi). 13 DS returned: 8 included, 5 excluded (KefranAbg/finepdfs fork of finepdfs; caoyuji/finewe…

517 languages2 copiesAbidji(abi)TextLM

HUHugging Face

Open24 Jul 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAbua(abn)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesKyode(acd)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAcholi(ach)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDangme(ada)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdele(ade)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdhola(adh)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdjoukrou(adj)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesTunisian Arabic(aeb)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAfrikaans(afr)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAhanta(aha)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAdja(ajg)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesSiwu(akp)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAlur(alz)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesHamer(amf)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAmharic(amh)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAndoni(ann)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesDenya(anv)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

dataset

fineweb-2

text-generation · NLP domain · HuggingFaceFW

517 languages2 copiesAnyin(any)Tabulartext-generation

HUHugging Face

Open27 Oct 2026

Related Datasets

dataset

WaxalNLP - large-scale African speech corpus (google/WaxalNLP), dga_asr subset (191,000 utterances)

CONFIRMED headline resource - the largest speech corpus for any language in this project. WaxalNLP lists subset 'dga_asr' with 191,000 rows (verified on the …

8 languages15 copiesSouthern Dagaare(dga)SpeechGender data

HUHugging Face

Open2 Jul 2026

dataset

Dagaare Wikipedia (dga.wikipedia.org) - full wiki dump (wikimedia/wikipedia & mirrors)

CONFIRMED (edition exists; verify snapshot). The Dagaare Wikipedia went live at dga.wikipedia.org in Dec 2023 (the 3rd Mabia language on Wikipedia). Its arti…

49 languages32 copiesSouthern Dagaare(dga)TextLM

HUHugging Face

Open2 Jul 2026

dataset

DCAD-2000 - Multilingual Common-Crawl corpus (openbmb/DCAD-2000), dga_Latn subset

VERY LIKELY (verify). DCAD-2000 (2000+ langs from FineWeb/Fineweb-2 + MaLA + Common Crawl). If dga is in FineWeb-2 (expected), a 'dga_Latn' subset follows. F…

577 languagesSouthern Dagaare(dga)TextLM

HUHugging Face

Open2 Jul 2026