cachedInputTokens property

int? cachedInputTokens

CachedInputTokens is the prompt tokens served from the provider's cache; omitted when unknown.

Please note: This property should have been non-nullable! Since the specification file does not include a default value (using the "default:" property), however, the generated source code must fall back to having a nullable type. Consider adding a "default:" property in the specification file to hide this note.

Implementation

int? cachedInputTokens;