menu
langchain_tiktoken package
documentation
langchain_tiktoken.dart
Tiktoken
specialTokensSet property
specialTokensSet property
dark_mode
light_mode
specialTokensSet
property
Set
<
String
>
specialTokensSet
late
final
A set of special tokens keys
Implementation
late final Set<String> specialTokensSet;
langchain_tiktoken package
documentation
langchain_tiktoken
Tiktoken
specialTokensSet property
Tiktoken class