tiktoken_tokenizer_gpt4o_o1 1.2.1 
tiktoken_tokenizer_gpt4o_o1: ^1.2.1 copied to clipboard
Published 6 months ago • 
glasberg.dev
glasberg.devOpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.
5 versions
Stable versions of tiktoken_tokenizer_gpt4o_o1
| Version | Min Dart SDK | Uploaded | Documentation | Archive | |
|---|---|---|---|---|---|
| 1.2.1 | 3.3 | 6 months ago |  |  | |
| 1.2.0 | 3.5 | 6 months ago |  | | |
| 1.1.0 | 3.5 | 10 months ago | | ||
| 1.0.2 | 3.5 | 11 months ago | | ||
| 1.0.1 | 3.5 | 11 months ago | |
Metadata
2
likes
140
points
195
downloads
Publisher
Weekly Downloads
Metadata
OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.
Repository (GitHub)
View/report issues
Topics
#tokenizer #openai #gpt #gpt-4o #tiktoken
Documentation
License
BSD-2-Clause (license)
