Intended Use Cases
LID for 1665 languages
Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
The same resource, also published at these locations. It is counted once.
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
Language identification model covering 1,600+ languages including Dangme (ada). 108K downloads. fastText-based. Can detect and distinguish Dangme text from o…
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
General low-resource language identification model. Include as candidate LID support only; Esimbi / ags-specific inclusion should be verified against the cur…
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
Verified in supported-languages file
Adebara et al. 2023
Adebara et al. 2024