tiktoken 1.0.3 tiktoken: ^1.0.3 copied to clipboard
Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.
Stable versions of tiktoken
Version | Min Dart SDK | Uploaded | Documentation | Archive | |
---|---|---|---|---|---|
1.0.3 | Null safety | 2.15 | 19 months ago | ||
1.0.2 | Null safety | 2.15 | 20 months ago | ||
1.0.1 | Null safety | 2.15 | 20 months ago | ||
1.0.0 | Null safety | 2.15 | 20 months ago |