langchain_tiktoken 1.0.1 copy "langchain_tiktoken: ^1.0.1" to clipboard
langchain_tiktoken: ^1.0.1 copied to clipboard

Published 11 months ago • verified publisherdragonx.cloudDart 3 compatible
SDKDartFlutter
PlatformAndroidiOSLinuxmacOSwebWindows
→

Metadata

A BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

More...

Changelog #

1.0.1 #

  • Switched to using 'parts' and only cl100kBase.

1.0.0 #

  • Initial version.

← Metadata

2
likes
140
points
4.71k
downloads

Publisher

verified publisherdragonx.cloud

Weekly Downloads

Metadata

A BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

More

Packages that depend on langchain_tiktoken

Back