decodeBytes method

Uint8List decodeBytes(
  1. List<int> tokens
)

Decodes a list of tokens into bytes. Example:

final enc = Tiktoken.getEncoderForModel(OpenAiModel.gpt_4);
enc.decodeBytes([31373, 995]);

Implementation

Uint8List decodeBytes(List<int> tokens) {
  return _coreBPE.decodeNative(tokens).bytes;
}