tokenization
| Date | Project Name | 🎉 | ? | Tags |
|---|---|---|---|---|
| 01/24 |
uax29 v2.4.0
* [uax29 v2.4.0](https://github.com/clipperhouse/uax29) – Unicode UAX #29-based tokenizer for Go, splitting graphemes, words, phrases and sentences.
Unicode UAX #29-based tokenizer for Go, splitting graphemes, words, phrases and sentences.
|
7
|
Go 98 ⭐2111 days old |
golang go unicode tokenization uax29 |