cachedPromptTokens property

  1. @TagNumber.new(20)
int get cachedPromptTokens

Prompt/cache accounting surfaced by llama.cpp/CoreML-style backends.

Implementation

@$pb.TagNumber(20)
$core.int get cachedPromptTokens => $_getIZ(19);
  1. @TagNumber.new(20)
set cachedPromptTokens (int value)

Implementation

@$pb.TagNumber(20)
set cachedPromptTokens($core.int value) => $_setSignedInt32(19, value);