tiktoken_tokenizer_gpt4o_o1 1.0.2 copy "tiktoken_tokenizer_gpt4o_o1: ^1.0.2" to clipboard
tiktoken_tokenizer_gpt4o_o1: ^1.0.2 copied to clipboard

OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.

1.0.2 #

  • Supports: Gpt-4, Gpt-4o, Gpt-4o-mini, o1, o1-mini, and o1-preview.
1
likes
150
pub points
14%
popularity

Publisher

verified publisherglasberg.dev

OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.

Repository (GitHub)
View/report issues

Documentation

API reference

License

BSD-2-Clause (license)

Dependencies

characters, flutter

More

Packages that depend on tiktoken_tokenizer_gpt4o_o1