draftedTokenCount property

int? draftedTokenCount
final

Tokens proposed by the draft model; null when the session runs without speculative decoding.

Implementation

final int? draftedTokenCount;