tensor_split property

Pointer<Float> tensor_split
getter/setter pair

proportion of the model (layers or rows) to offload to each GPU, size: llama_max_devices()

Implementation

external ffi.Pointer<ffi.Float> tensor_split;