f16_kv property

  1. @Bool()
bool f16_kv
getter/setter pair

use fp16 for KV cache, fp32 otherwise

Implementation

@ffi.Bool()
external bool f16_kv;