LLAMA_FTYPE_MOSTLY_Q4_K_M constant
int
const LLAMA_FTYPE_MOSTLY_Q4_K_M
except 1d tensors
Implementation
static const int LLAMA_FTYPE_MOSTLY_Q4_K_M = 15;
except 1d tensors
static const int LLAMA_FTYPE_MOSTLY_Q4_K_M = 15;