llama_model_decoder_start_token function

  1. @Native<llama_token Function(Pointer<llama_model>)>(ffi.Pointer<llama_model>)>()
int llama_model_decoder_start_token(
  1. Pointer<llama_model> model
)

For encoder-decoder models, this function returns id of the token that must be provided to the decoder to start generating output sequence. For other models, it returns -1.

Implementation

@ffi.Native<llama_token Function(ffi.Pointer<llama_model>)>()
external int llama_model_decoder_start_token(
  ffi.Pointer<llama_model> model,
);