decodeTokensPerSecond property

double get decodeTokensPerSecond

Generation speed, in tokens per second.

Implementation

double get decodeTokensPerSecond =>
    _rate(generatedTokenCount, decodeDuration);