cachedTokenCount property

int cachedTokenCount
final

Prompt tokens served from the reused KV-cache prefix.

Implementation

final int cachedTokenCount;