akashi_gemma 0.3.0
akashi_gemma: ^0.3.0 copied to clipboard
On-device LanguageModel for the Akashi agent framework, backed by flutter_gemma: run agents fully offline, or as the primary in a cloud FallbackModel chain.
Changelog #
0.3.0 #
- Initial release of the on-device adapter.
GemmaModelimplementsLanguageModelover aGemmaBackendseam, normalizing on-device tokens →TextDeltaPart, thinking →ReasoningDeltaPart, and function calls →ToolCallCompletePart. No HTTP — proves the contract is not transport-bound. Pairs withakashi_gateway'sFallbackModel. Streaming honorsrequest.cancelto stop long on-device generation.FlutterGemmaBackendwraps flutter_gemma 1.x'sInferenceChatfor real device inference (including parallel function calls); theGemmaBackendseam keeps normalization testable offline. Requires Dart ≥3.12 / Flutter ≥3.44.GemmaProvidermintsGemmaModels over a shared backend.