offloadKqv property

bool offloadKqv
getter/setter pair

Whether to offload the KQV ops (including the KV cache) to GPU

Implementation

bool offloadKqv = true;