tokenCount method

  1. @override
Future<int?> tokenCount(
  1. String text
)
override

Token count for text from the model's own tokenizer, or null when it cannot be obtained (no engine, native call failed). Callers must handle null rather than assume a number — this feeds context budgeting, and the four-chars-per-token estimate it replaced undercounts Chinese by more than half (measured 0.44x on gemma-4-E2B-it) while looking authoritative.

Implementation

@override
Future<int?> tokenCount(String text) => _live.tokenCount(text);