lib_llama_cpp 0.4.0
lib_llama_cpp: ^0.4.0 copied to clipboard
App-facing Flutter plugin facade and inference isolate scheduler for llama.cpp.
Unreleased #
0.4.0 #
- Added chat-template-aware
LlamaGenerateMessagesCommandfor multipart messages while keeping rawLlamaGenerateCommand(prompt: ...)unchanged. - Added image/audio content parts,
mmprojPathmodel configuration, runtime model capabilities, and unsupported-capability errors for media requests. - Added OpenAI-style function tool definitions, tool choices, tool call
responses, tool result message fields, and
requires_actionstream events. - Document CPU-only native platform packages built by the GitHub release workflow.
0.1.0 #
- Initial release of the app-facing Flutter plugin facade.
- Added command and response types for model loading, generation, and disposal.
- Added inference isolate lifecycle orchestration and federated platform lookup.