responses method

Stream<ModelResponse>? responses(
  1. InferenceModelSession session, {
  2. required int tokenBuffer,
})

The whole of one turn — generation, parsing, token accounting, the history append, the overflow rebuild — or null for core's.

Implementation

Stream<ModelResponse>? responses(
  InferenceModelSession session, {
  required int tokenBuffer,
}) => null;