gpt_tokenizer 0.1.1 copy "gpt_tokenizer: ^0.1.1" to clipboard
gpt_tokenizer: ^0.1.1 copied to clipboard

The implementation of BPE algorithm for sentence encode/decode

Stable versions of gpt_tokenizer

VersionMin Dart SDKUploadedDocumentationArchive
0.1.1Null safety3.010 months agoGo to the documentation of gpt_tokenizer 0.1.1Download gpt_tokenizer 0.1.1 archive
0.1.0Null safety2.1821 months agoGo to the documentation of gpt_tokenizer 0.1.0Download gpt_tokenizer 0.1.0 archive
0
likes
120
points
275
downloads

Publisher

verified publishersimonwang.dev

Weekly Downloads

The implementation of BPE algorithm for sentence encode/decode

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

Dependencies

ffi, flutter_rust_bridge, meta, uuid

More

Packages that depend on gpt_tokenizer