lib_llama_cpp 0.7.3
lib_llama_cpp: ^0.7.3 copied to clipboard
App-facing Flutter plugin facade and inference isolate scheduler for llama.cpp.
Unreleased #
- Exported
lib_llama_cpp_serverfrom the app-facing facade and documented server mode as the recommended local-model integration path. - Documented CPU-only pub.dev prebuilts with separate Metal, Vulkan, and CUDA GitHub release assets.
- Stream parsed plain-text deltas during tool-aware message generation while preserving structured tool-call parsing.
- Added Metal capability reporting for bundled Apple libraries and explicit unsupported-capability errors for bundled CPU-only libraries.
- Added CMake build options for Metal, CUDA, and Vulkan native backend builds.
0.4.0 #
- Added chat-template-aware
LlamaGenerateMessagesCommandfor multipart messages while keeping rawLlamaGenerateCommand(prompt: ...)unchanged. - Added image/audio content parts,
mmprojPathmodel configuration, runtime model capabilities, and unsupported-capability errors for media requests. - Added OpenAI-style function tool definitions, tool choices, tool call
responses, tool result message fields, and
requires_actionstream events. - Document CPU-only native platform packages built by the GitHub release workflow.
0.1.0 #
- Initial release of the app-facing Flutter plugin facade.
- Added command and response types for model loading, generation, and disposal.
- Added inference isolate lifecycle orchestration and federated platform lookup.