flutter_mind_local 0.1.0 copy "flutter_mind_local: ^0.1.0" to clipboard
flutter_mind_local: ^0.1.0 copied to clipboard

On-device AI inference for Flutter using llama.cpp via FFI. Local engine companion to flutter_mind.

0.1.0 #

  • Initial release.
  • LocalEngine — on-device LLM inference via llama.cpp, no API key or internet required.
  • LocalConfig — full configuration: model path, system prompt, temperature, context size, sampling parameters.
  • LocalModelType — built-in chat templates for Qwen, Llama 3, Gemma, Phi, Mistral, DeepSeek, with auto-detection from .gguf metadata.
  • Lifecycle events via onEvent: ModelLoadStarted, ModelReady, ModelFailed, InferenceStarted, InferenceCompleted, InferenceFailed, ContextCleared, ModelDisposed.
  • Android support via CMake + FetchContent (llama.cpp built from source).
  • iOS and macOS support via Swift Package Manager (llama.cpp built from source).
  • Model loading and inference run on background isolates — UI thread never blocked.
0
likes
0
points
49
downloads

Publisher

unverified uploader

Weekly Downloads

On-device AI inference for Flutter using llama.cpp via FFI. Local engine companion to flutter_mind.

Repository (GitHub)
View/report issues

Topics

#ai #llm #ffi #on-device-ai #llama

License

unknown (license)

Dependencies

ffi, flutter, flutter_mind, meta

More

Packages that depend on flutter_mind_local

Packages that implement flutter_mind_local