initNuma static method

void initNuma(
  1. NumaStrategy strategy
)

Configure NUMA awareness. Call before the first model load if you need a non-default strategy; calling later has no effect. Defaults to disabled and only matters on multi-socket Linux servers.

Implementation

static void initNuma(NumaStrategy strategy) {
  bindings.llama_numa_init(ggml_numa_strategy.fromValue(strategy.value));
}