maxDraftTokens property

int maxDraftTokens

Upper bound on tokens the drafter proposes per speculation step.

Defaults to 3, matching upstream llama.cpp's speculative n_max: at sampling temperatures the per-token acceptance rate makes longer draft chains net-negative (every rejected token costs a wasted draft decode plus a wasted verification slot).

Implementation

final int maxDraftTokens;