menu
sp_ai_simple_bpe_tokenizer package
documentation
models/sp_token_container.dart
SPTokenContainer
tokens property
tokens property
dark_mode
light_mode
tokens
property
List
<
int
>
?
tokens
final
An list of integer tokens that represent the encoded text.
Implementation
final List<int>? tokens;
sp_ai_simple_bpe_tokenizer package
documentation
models/sp_token_container
SPTokenContainer
tokens property
SPTokenContainer class