menu
llama_library package
documentation
io/models/model_params.dart
LLamaModelParams
tensorSplit property
tensorSplit property
dark_mode
light_mode
tensorSplit
property
List
<
double
>
tensorSplit
getter/setter pair
Proportion of the model (layers or rows) to offload to each GPU
Implementation
List<double> tensorSplit = [];
llama_library package
documentation
io/models/model_params
LLamaModelParams
tensorSplit property
LLamaModelParams class