tiktoken_tokenizer_gpt4o_o1 1.1.0 copy "tiktoken_tokenizer_gpt4o_o1: ^1.1.0" to clipboard
tiktoken_tokenizer_gpt4o_o1: ^1.1.0 copied to clipboard

OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add tiktoken_tokenizer_gpt4o_o1

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  tiktoken_tokenizer_gpt4o_o1: ^1.1.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:tiktoken_tokenizer_gpt4o_o1/tiktoken_tokenizer_gpt4o_o1.dart';
1
likes
150
pub points
27%
popularity

Publisher

verified publisherglasberg.dev

OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.

Repository (GitHub)
View/report issues

Topics

#tokenizer #openai #gpt #gpt-4o #tiktoken

Documentation

API reference

License

BSD-2-Clause (license)

Dependencies

characters, flutter

More

Packages that depend on tiktoken_tokenizer_gpt4o_o1