prefillTokensPerSecond property

double get prefillTokensPerSecond

Prompt-ingestion speed over the tokens that were actually decoded (prompt minus cached), in tokens per second.

Implementation

double get prefillTokensPerSecond =>
    _rate(promptTokenCount - cachedTokenCount, prefillDuration);