litertlm_dart 0.0.1-dev.1
litertlm_dart: ^0.0.1-dev.1 copied to clipboard
Dart FFI bindings to Google's LiteRT-LM runtime — run Large Language Models on-device (Gemma, Qwen, Phi and more) with CPU / GPU / NPU acceleration. Pure Dart, no Flutter. Name reserved; first release [...]
litertlm_dart #
Dart FFI bindings to Google's LiteRT-LM runtime — run Large Language Models on-device (Gemma, Qwen, Phi, DeepSeek and more) with CPU / GPU / NPU acceleration. Pure Dart, no Flutter.
For a Flutter-integrated experience, use the umbrella package (flutter_edge) which builds on this.
⚠️ Name reserved. This is a placeholder while the package is being prepared. The first functional release is coming soon.
- Repository: https://github.com/DenisovAV/flutter_gemma
- Maintained by sashadenisov.dev