llama_decode method

int llama_decode(
  1. Pointer<llama_context> ctx,
  2. llama_batch batch
)

Positive return values does not mean a fatal error, but rather a warning. 0 - success 1 - could not find a KV slot for the batch (try reducing the size of the batch or increase the context) < 0 - error

Implementation

int llama_decode(
  ffi.Pointer<llama_context> ctx,
  llama_batch batch,
) {
  return _llama_decode(
    ctx,
    batch,
  );
}