flutter_gemma_litertlm 1.6.1

LiteRT-LM (.litertlm) on-device inference engine for flutter_gemma via dart:ffi (5 native platforms) + web. Opt-in InferenceEngineProvider. Also ships the LiteRT C API embedding backend (LiteRtEmbeddi [...]

1.6.1

• Docs: the README and library docs show the engine-carried resolver and the one-call fromHuggingFace(repo) install.

1.6.0

• Add LitertlmManifestResolver: manifest-driven Hugging Face install for repos shipping litertlm_manifest.json, auto-registered from LiteRtLmEngine (#454).

1.5.3

• Fix a rebuilt native library not reaching the build.

1.5.2

• Android: embeddings no longer poison the loader, fixing zero-chunk streams and SIGABRT (#447).

1.5.1

• Share the host-side native library lookup with core instead of a private copy.

1.5.0

• Add LiteRT embedding forward-pass + LiteRtEmbeddingBackend (moved from flutter_gemma_embeddings).
• internal: wire the new tokenizerFactory descriptor field; byte-identical vectors, no API change.

1.4.3

• fix: a native-archive checksum mismatch now fails the build instead of shipping no library.
• fix: sizeInTokens asks the model's tokenizer on native; web still estimates (no tokenizer).
• fix: sampler params and maxOutputTokens now reach the NPU backend; the guards had expired upstream.
• fix: find the dev prebuilt from any package's directory, not only this one's.

1.4.2

• fix: vision + audio encoders default to CPU (fixes GPU vision hard-fail on Metal/WebGPU); overridable.

1.4.1

• Fix Windows NPU: the OpenVino compiler DLLs shipped but were never bundled into the app.
• Drop the debug TBB variants that were being bundled alongside the release set.

1.4.0

• Migrate to LiteRT-LM v0.16.0 (native-v0.16.0) — fixes the Android OpenCL per-turn leak (#348, #402).
• Detect the stream-callback ABI at runtime — v0.15.0 changed it with no compat path.
• Fix Windows discrete GPU: a Bazel define we passed had been removed upstream.
• Rebuild both NPU dispatch stacks from the pin instead of shipping stale prebuilts.
• Pin the macOS deployment target of libStreamProxy.dylib to 11.0 instead of the build host's.
• Native platforms only — web stays on @litert-lm/core 0.14.0 (the 0.16.0 npm publish ships no dist/).

1.3.1

• Clearer engine-create error for GPU-only .litertlm models run on CPU (#390).

1.3.0

• Also expose the LiteRt interpreter (LiteRtBindings) for embeddings/speech; own web litert.js.

1.2.0

• Migrate FFI to LiteRT-LM v0.14.0 — native per-session sampler (opaque session-config); native-v0.14.0.
• Fix #214 GPU output garbage via the v0.14.0 runtime — verified on Xclipse.
• Bump web @litert-lm/core 0.12.1 → 0.14.0 (text path; API-compatible).
• Known regression: Windows discrete GPU broken upstream (LiteRT-LM #2957) — use CPU/NPU on Windows.

1.1.0

• Smooth UI during Android GPU prefill — flush the OpenCL queue every 2 ops (#364).

1.0.4

• Guard native cancel against a freed conversation — fixes a use-after-free SIGSEGV on close-mid-stream (#379).

1.0.3

• Create the native conversation off the main isolate to avoid ANRs on multimodal models (#365).
• Serialize native conversation create on the engine mutex to prevent a heap-corrupting race (#372).
• Cancel native decode before tearing a conversation down to avoid a multi-second ANR (#364, #373).

1.0.2

• Clamp maxTokens up to 1024 (min context for .litertlm) to fix the DYNAMIC_UPDATE_SLICE crash (#318).
• Honor maxOutputTokens (session + chat) via native set_max_output_tokens; skipped on NPU.

1.0.1

• Fix PreferredBackend.npu on Android (Qualcomm) + Windows (Intel): native-v0.13.1-a restores the NPU dispatch libs omitted from 1.0.0 (#155).
• Point homepage to fluttergemma.dev. No code change.

1.0.0

• Stable 1.0.0; spec imports redirected off the dart:io mobile lib for a wasm-clean web graph.

1.0.0-rc.1

• Initial release: LiteRT-LM (.litertlm) on-device inference engine for flutter_gemma via dart:ffi.
• Provides LiteRtLmEngine (InferenceEngineProvider). Owns the shared LiteRT-LM native library.
• Android, iOS, macOS, Linux, Windows + web (@litert-lm/core, early preview).