Datasets
DATASETHugging Face
4/5

FineFreq Frequency-Weighted Text Dataset (lgi2p)

Abidji(abi)TextLMWest Africa
View Source

Dataset Info

Language
Abidji (abi)
Modality
Text
Domain
General
Size
1M<n<10M
Institution
lgi2p
Last Updated
24 Jul 2026

License & Access

SPDX identifierCC-BY-4.0

Open — attribution required; commercial use allowed.

RedistributionYes

PII RISK

Unknown risk

Full Record

30 of 46 fields stated

Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.

Registry columns (22/27)

iso code
abi
Dataset name
FineFreq Frequency-Weighted Text Dataset (lgi2p)
Modality
Text
Type
dataset
Link
https://huggingface.co/datasets/lgi2p/finefreq
NLP Task
LM
Domain
General
Data Format
parquet
Size Metric
n (samples)
Size Value
1M<n<10MderivedHugging Face card: size_categories
License
CC-BY-4.0
Open Access
Open
Source Repository
Hugging Face
Year Published
2024
Creator/Author(s)
lgi2p
Funder/Partner
Not stated
Dialect Coverage
Standard
Gender Balance
Not stated
Speaker Count
Not stated
Annotation Type
Automatic
Status
Active
Has Datasheet
No
PII Risk
Not stated
Consent Verified
Not stated
Verified By
Emmanuel
Date Indexed
2026-07-24
Notes / Flags
Word frequency-weighted multilingual corpus tagged for Abidji (abi).

Quality (DQI) (7/12)

Datasheet Fields Completed
Not stated
SPDX License ID
CC-BY-4.0
Redistribution Allowed?
Yes
Content Hash
d632365ef1c86c734960caa962eaa2d4038c715aderivedHugging Face card: commit sha
Submitted By
hf_data pipeline (automated)
Fetch Date
2026-07-24
Last Updated Date
2025-12-11derivedHugging Face card: lastModified
Annotation Guidelines Available?
Not stated
IAA Score
Not stated
Cleaning Notes
Frequencies are raw counts (not percentages), normalized later as needed.derivedHugging Face card: "Frequencies are raw counts (not percentages), normalized later as needed."
Benchmark Exists?
Not stated
Benchmark Citation
Not stated

Representativeness (DRI) (1/7)

Gender Distribution
Not stated
Region Coverage
Not stated
Region Distribution
Not stated
Age Range Coverage
Not stated
Register
Not stated
Marginalized Group Note
Not stated
Demographic Fields Reported Count
0

Readiness Score Breakdown

4/5
Data Coverage71%
Model Availability100%
Benchmarks100%
Documentation76%
Recency100%

Representativeness

Gender Balance
Regional Distribution
Dialect Coverage
Inclusivity

Provenance

Fetch Timestamp
24 Jul 2026
Content Hash
d632365ef1c86c734960caa962eaa2d4038c715a

Audit Log

Record indexed from Hugging Face

24 Jul 2026

Source status: Active

24 Jul 2026

Also Available In

This is the same multilingual corpus, sliced for other languages the platform indexes it under.

dataset

finefreq

Data format: parquet

531 languagesAbé(aba)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAbua(abn)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesKyode(acd)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAcholi(ach)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesDangme(ada)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAdele(ade)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAdhola(adh)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAdjoukrou(adj)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesTunisian Arabic(aeb)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAfrikaans(afr)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAhanta(aha)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAdja(ajg)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesSiwu(akp)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAlur(alz)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesHamer(amf)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAmharic(amh)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAndoni(ann)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesDenya(anv)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAnyin(any)Tabular
HUHugging Face
Open27 Oct 2026
dataset

finefreq

Data format: parquet

531 languagesAlgerian Arabic(arq)Tabular
HUHugging Face
Open27 Oct 2026

Related Datasets