Datasets
DATASETHugging Face
4/5

GlotCC-V1 Multilingual Web Corpus (CIS-LMU)

Berom(bom)TextLMWest Africa
View Source

Dataset Info

Language
Berom (bom)
Modality
Text
Domain
General
Size
1B<n<10B
Institution
CIS-LMU (LMU Munich)
Last Updated
27 Jul 2026

License & Access

SPDX identifiercc0-1.0

Public domain — no rights reserved; unrestricted use.

RedistributionYes

PII RISK

Unknown risk

Full Record

29 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (22/27)

iso code
bom
Dataset name
GlotCC-V1 Multilingual Web Corpus (CIS-LMU)
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/cis-lmu/GlotCC-V1
NLP Task
LM
Domain
General
Data Format
parquetderivedHugging Face card: file formats
Size Metric
n (samples)
Size Value
1B<n<10BderivedHugging Face card: size_categories
License
cc0-1.0
Open Access
Open
Source Repository
Hugging Face
Year Published
2023
Creator/Author(s)
CIS-LMU (LMU Munich)
Funder/Partner
Not stated
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Automatic
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Emmanuel
Date Indexed
2026-07-27
Notes / Flags
Multilingual Common Crawl corpus covering 1,000+ languages including Berom (bom). innadark fork excluded.

Quality (DQI) (6/12)

Datasheet Fields Completed
Not stated
SPDX License ID
CC0-1.0
Redistribution Allowed?
Yes
Content Hash
9ad140b6be3ac7b539606a2b4809b49d122823dederivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-07-27
Last Updated Date
2024-11-01derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

4/5
Data Coverage80%
Model Availability100%
Benchmarks100%
Documentation69%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Source URL
https://huggingface.co/datasets/cis-lmu/GlotCC-V1
Fetch Timestamp
27 Jul 2026
Content Hash
9ad140b6be3ac7b539606a2b4809b49d122823de

Audit Log

Record indexed from Hugging Face

27 Jul 2026

Source status: Active

27 Jul 2026

Other Copies

The same resource, also published at these locations. It is counted once.

dataset

GlotCC-V1

NLP domain · innadark

246 languages2 copiesBerom(bom)Tabular
HUHugging Face
Open27 Oct 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAcholi(ach)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesDangme(ada)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAdjoukrou(adj)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesTunisian Arabic(aeb)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAfrikaans(afr)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesHamer(amf)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAmharic(amh)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAndoni(ann)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAnyin(any)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAlgerian Arabic(arq)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesMoroccan Arabic (Darija)(ary)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesEgyptian Arabic(arz)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesAvokaya(avu)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBambara(bam)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBasaa(bas)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBariba(bba)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBaoulé(bci)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBaka(bdh)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBemba(bem)Tabular
HUHugging Face
Open27 Oct 2026
dataset

GlotCC-V1

NLP domain · cis-lmu

246 languages2 copiesBimoba(bim)Tabular
HUHugging Face
Open27 Oct 2026

Related Datasets

dataset

FineWeb-2 Multilingual Web Text Corpus (HuggingFaceFW)

Large-scale multilingual web text corpus tagged for Berom (bom). 15 DS returned: 9 included, 6 excluded (KefranAbg/finepdfs fork; caoyuji/fineweb-2 fork; ope…

517 languages2 copiesBerom(bom)TextLM
HUHugging Face
Open27 Jul 2026
dataset

FinePDFs Large-Scale Web Text Corpus (HuggingFaceFW)

Large-scale PDF-based web text corpus tagged for Berom (bom). KefranAbg fork excluded.

511 languages2 copiesBerom(bom)TextLM
HUHugging Face
Open27 Jul 2026
dataset

Language Tags Reference (lbourdois)

Multilingual language tag metadata dataset. Contains bom (Berom) as one of many language codes.

2,228 languagesBerom(bom)TextOther
HUHugging Face
Open27 Jul 2026