Datasets
DATASETHugging Face
2/5

PanLex (multilingual lexicon database)

Aduge(adu)TextLexicon/TranslationWest Africa
View Source

Dataset Info

Language
Aduge (adu)
Modality
Text
Domain
General
Size
24650274
Institution
Jonathan Pool
Last Updated
11 May 2026

License & Access

SPDX identifierCC0

Public domain — no rights reserved; unrestricted use.

RedistributionYes

PII RISK

Unknown risk

Full Record

27 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (21/27)

iso code
adu
Dataset name
PanLex (multilingual lexicon database)
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/lbourdois/panlex
NLP Task
Lexicon/Translation
Domain
General
Data Format
csvderivedHugging Face card: file formats
Size Metric
Entries
Size Value
24650274
License
CC0
Open Access
Open
Source Repository
Hugging Face
Year Published
2024derivedHugging Face card: createdAt
Creator/Author(s)
Jonathan Pool
Funder/Partner
Not stated
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Human
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Not stated
Date Indexed
2026-05-11
Notes / Flags
Comprehensive multilingual lexicon database with 24.6M vocabulary entries covering 6,152 languages; includes adu language translation pairs

Quality (DQI) (5/12)

Datasheet Fields Completed
Not stated
SPDX License ID
CC0-1.0
Redistribution Allowed?
Yes
Content Hash
feb3a878db0fdc93cadf739f3a2749be4d4698c8derivedHugging Face card: commit sha
Submitted By
Not stated
Fetch Date
2026-05-11
Last Updated Date
2024-02-03derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Not stated
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

2/5
Data Coverage46%
Model Availability29%
Benchmarks0%
Documentation17%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
11 May 2026
Content Hash
feb3a878db0fdc93cadf739f3a2749be4d4698c8

Audit Log

Record indexed from Hugging Face

11 May 2026

Source status: Active

11 May 2026

Other Copies

The same resource, also published at these locations. It is counted once.

Related Datasets