menu
llama_library package
documentation
io/models/context_params.dart
LLamaContextParams
nBatch property
nBatch property
dark_mode
light_mode
nBatch
property
int
nBatch
getter/setter pair
Logical maximum batch size that can be submitted to llama_decode
Implementation
int nBatch = 512;
llama_library package
documentation
io/models/context_params
LLamaContextParams
nBatch property
LLamaContextParams class