llama_get_logits method
Token logits obtained from the last call to llama_eval()
The logits for the last token are stored in the last row
Logits for which llama_batch.logitsi
== 0 are undefined
Rows: n_tokens provided with llama_batch
Cols: n_vocab
Implementation
ffi.Pointer<ffi.Float> llama_get_logits(
ffi.Pointer<llama_context> ctx,
) {
return _llama_get_logits(
ctx,
);
}