LLAMA_SPLIT_LAYER constant

int const LLAMA_SPLIT_LAYER

split layers and KV across GPUs

Implementation

static const int LLAMA_SPLIT_LAYER = 1;