main_gpu property

  1. @Int32()
int main_gpu
getter/setter pair

main_gpu interpretation depends on split_mode: LLAMA_SPLIT_NONE: the GPU that is used for the entire model LLAMA_SPLIT_ROW: the GPU that is used for small tensors and intermediate results LLAMA_SPLIT_LAYER: ignored

Implementation

@ffi.Int32()
external int main_gpu;