topK property
int
get
topK
Top K number of tokens to be sampled from for each decoding step.
Implementation
int get topK;
Top K number of tokens to be sampled from for each decoding step.
int get topK;