n_batch property

  1. @Uint32()
int n_batch
getter/setter pair

prompt processing maximum batch size

Implementation

@ffi.Uint32()
external int n_batch;