Language identification
Xiangliu
Names the language of a piece of text.
Hashed character n-grams into one hidden layer, trained from scratch on Tatoeba, Common Voice and SMOL. It runs in Python with NumPy or in plain JavaScript.
- Languages
- 284
- Model file
- 4.8 MB
- Speed
- 8,922 texts a second, one CPU thread, Python
- Licence
- MIT
| Model | File | Macro F1 |
|---|---|---|
| Xiangliu | 4.8 MB | 0.944 |
| GlotLID v4 small | 35 MB | 0.930 |
| fastText lid.176.bin | 131 MB | 0.837 |