menu
neomage package
documentation
utils/tokens/token_counter.dart
TokenEncoder
encode abstract method
encode abstract method
dark_mode
light_mode
encode
abstract method
List
<
int
>
encode
(
String
text
)
Encodes
text
into a list of token IDs.
Implementation
List<int> encode(String text);
neomage package
documentation
utils/tokens/token_counter
TokenEncoder
encode abstract method
TokenEncoder class