offload_kqv property

  1. @Bool()
bool offload_kqv
getter/setter pair

whether to offload the KQV ops (including the KV cache) to GPU

Implementation

@ffi.Bool()
external bool offload_kqv;