tiktoken 1.0.3 copy "tiktoken: ^1.0.3" to clipboard
tiktoken: ^1.0.3 copied to clipboard

Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

Stable versions of tiktoken

VersionMin Dart SDKUploadedDocumentationArchive
1.0.3Null safety2.1524 months agoGo to the documentation of tiktoken 1.0.3Download tiktoken 1.0.3 archive
1.0.2Null safety2.1524 months agoGo to the documentation of tiktoken 1.0.2Download tiktoken 1.0.2 archive
1.0.1Null safety2.152 years agoDownload tiktoken 1.0.1 archive
1.0.0Null safety2.152 years agoDownload tiktoken 1.0.0 archive
22
likes
160
points
1.3k
downloads

Publisher

verified publishermarinvitlov.com

Weekly Downloads

2024.09.13 - 2025.03.28

Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

Homepage
Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

More

Packages that depend on tiktoken