tiktoken 1.0.3 copy "tiktoken: ^1.0.3" to clipboard
tiktoken: ^1.0.3 copied to clipboard

Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

Stable versions of tiktoken

VersionMin Dart SDKUploadedDocumentationArchive
1.0.3Null safety2.1519 months agoGo to the documentation of tiktoken 1.0.3Download tiktoken 1.0.3 archive
1.0.2Null safety2.1520 months agoGo to the documentation of tiktoken 1.0.2Download tiktoken 1.0.2 archive
1.0.1Null safety2.1520 months agoDownload tiktoken 1.0.1 archive
1.0.0Null safety2.1520 months agoDownload tiktoken 1.0.0 archive
21
likes
160
pub points
88%
popularity

Publisher

verified publishermarinvitlov.com

Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

Homepage
Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

More

Packages that depend on tiktoken