Intended Use Cases
LID for 1665 languages (broader than AfroLID)
Open — attribution required; commercial use allowed.
Every column the registry tracks. Values marked derivedwere filled by a rule or read from the source's text rather than stated in its metadata; the rule or the quoted sentence is shown under the value.
This is the same multilingual corpus, sliced for other languages the platform indexes it under.
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
Language identification model covering 1,600+ languages including Dangme (ada). 108K downloads. fastText-based. Can detect and distinguish Dangme text from o…
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
General low-resource language identification model. Include as candidate LID support only; Esimbi / ags-specific inclusion should be verified against the cur…
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
text-classification model · fasttext · cis-lmu
Pratap et al. 2023 Meta AI; arXiv:2305.13516
Pratap et al. 2023 Meta AI
Pratap et al. 2023 Meta AI