liteRtLmFreshConversationEachTurn function

bool liteRtLmFreshConversationEachTurn({
  1. required BackendKind? backend,
  2. NpuStack? npuVendor,
})

Whether every turn of a model loaded on backend (the NPU stack npuVendor) needs a fresh native conversation that replays the history (liteRtLmFreshConversationNpus), in createSession and openSession sessions alike.

Implementation

bool liteRtLmFreshConversationEachTurn({
  required BackendKind? backend,
  NpuStack? npuVendor,
}) =>
    backend == BackendKind.npu &&
    liteRtLmFreshConversationNpus.contains(npuVendor);