tokenCount method
Token count for text from the model's own tokenizer, or null when it
cannot be obtained (no engine, native call failed). Callers must handle
null rather than assume a number — this feeds context budgeting, and the
four-chars-per-token estimate it replaced undercounts Chinese by more than
half (measured 0.44x on gemma-4-E2B-it) while looking authoritative.
Implementation
@override
Future<int?> tokenCount(String text) => _live.tokenCount(text);