Datasets
DATASETOther
4/5

PanLex: World vocabulary listing

Beja(bej)TextLexiconNorth Africa
View Source

Dataset Info

Language
Beja (bej)
Modality
Text
Domain
General
Size
—
Institution
Other
Last Updated
26 May 2026

License & Access

SPDX identifierUnknown

License unknown — use with caution until an SPDX identifier is confirmed.

RedistributionAllowed

PII RISK

Unknown risk

Full Record

19 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (16/27)

iso code
bej
Dataset name
PanLex: World vocabulary listing
Modality
Text
Type
database_entry
Link
https://vocab.panlex.org/
NLP Task
Lexiconderivedkeyword 'vocabular' in the title
Domain
General
Data Format
Not stated
Size Metric
Not stated
Size Value
Not stated
License
Not stated
Open Access
Open
Source Repository
Other
Year Published
Not stated
Creator/Author(s)
Not stated
Funder/Partner
Other
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Not stated
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Lanfrica Pipeline
Date Indexed
2026-05-26
Notes / Flags
Parsed from Lanfrica name: panlex-world-vocabulary-listing. Raw license: https://panlex.org/license/.

Quality (DQI) (2/12)

Datasheet Fields Completed
Not stated
SPDX License ID
Not stated
Redistribution Allowed?
Not stated
Content Hash
Not stated
Submitted By
LanAfrica pipeline (automated)
Fetch Date
2026-05-26
Last Updated Date
Not stated
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

4/5
Data Coverage80%
Model Availability92%
Benchmarks33%
Documentation57%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Source URL
https://vocab.panlex.org/
Fetch Timestamp
26 May 2026
Content Hash
—

Audit Log

Record indexed from Other

26 May 2026

Source status: Active

26 May 2026

Other Copies

This is a copy of the resource below, which the platform counts and shows in search.

dataset

PanLex Language Vocabulary (lbourdois/panlex)

PanLex Language Vocabulary (January 2024), 24.65M rows across 6152 languages including Beja (bej confirmed via HuggingFace language tag). World's largest lex…

113 languages5 copiesBeja(bej)TextMT
HUHugging Face
Open19 May 2026
dataset

PanLex Meanings (cointegrated/panlex-meanings)

Words across thousands of languages with semantic meaning links. 1012 languages including Beja (bej confirmed via HuggingFace language tag). Fork gtak1/panle…

113 languages5 copiesBeja(bej)TextMT
HUHugging Face
Open19 May 2026
dataset

panlex-meanings

Data format: csv

113 languages5 copiesBeja(bej)Tabulartranslation
HUHugging Face
Open27 Oct 2026

Related Datasets

dataset

MMS Ulab v2 (espnet/mms_ulab_v2)

Massively multilingual unlabeled speech, 4023 languages confirmed including Beja (bej) via HuggingFace language tag. 8900 total hours. 3 derived forks also t…

1,433 languages3 copiesBeja(bej)SpeechASR
HUHugging Face
Open19 May 2026
dataset

Universal Dependencies Treebank Collection (commul/universal_dependencies)

Universal Dependencies treebank collection on HuggingFace, 193 languages including Beja (UD_Beja-Autogramm: 763 sentences, 11,948 tokens). Bej confirmed via …

2 languages2 copiesBeja(bej)Texttoken-classification
HUHugging Face
Open19 May 2026
dataset

ChiKhaPo: Multilingual Lexical Benchmark (ec5ug/chikhapo)

Multilingual benchmark for lexical comprehension and generation, 2752 languages including Beja (bej confirmed via HuggingFace language tag). 8 subtasks. Draw…

857 languagesBeja(bej)TextClassification
HUHugging Face
Open19 May 2026