gpt_tokenizer 0.1.1 gpt_tokenizer: ^0.1.1 copied to clipboard
The implementation of BPE algorithm for sentence encode/decode
Stable versions of gpt_tokenizer
Version | Min Dart SDK | Uploaded | Documentation | Archive | |
---|---|---|---|---|---|
0.1.1 | Null safety | 3.0 | 9 months ago | ||
0.1.0 | Null safety | 2.18 | 19 months ago |