generateChat abstract method

Stream<List<int>> generateChat(
  1. int contextHandle,
  2. List<LlamaChatMessage> messages,
  3. GenerationParams params, {
  4. List<ToolDefinition>? tools,
  5. ToolChoice toolChoice = ToolChoice.auto,
  6. bool parallelToolCalls = false,
  7. bool enableThinking = true,
  8. Map<String, dynamic>? chatTemplateKwargs,
  9. @Deprecated("Use chatTemplateKwargs: {'source_lang_code': ...} instead.") String? sourceLangCode,
  10. @Deprecated("Use chatTemplateKwargs: {'target_lang_code': ...} instead.") String? targetLangCode,
  11. DateTime? templateNow,
})

Generates from structured chat state.

The deprecated sourceLangCode and targetLangCode set the source_lang_code and target_lang_code keys of chatTemplateKwargs.

Implementation

Stream<List<int>> generateChat(
  int contextHandle,
  List<LlamaChatMessage> messages,
  GenerationParams params, {
  List<ToolDefinition>? tools,
  ToolChoice toolChoice = ToolChoice.auto,
  bool parallelToolCalls = false,
  bool enableThinking = true,
  Map<String, dynamic>? chatTemplateKwargs,
  @Deprecated("Use chatTemplateKwargs: {'source_lang_code': ...} instead.")
  String? sourceLangCode,
  @Deprecated("Use chatTemplateKwargs: {'target_lang_code': ...} instead.")
  String? targetLangCode,
  DateTime? templateNow,
});