picolm_flutter 0.0.2 copy "picolm_flutter: ^0.0.2" to clipboard
picolm_flutter: ^0.0.2 copied to clipboard

On-device LLM inference engine for Flutter. Run LLaMA-architecture models via Dart FFI — no cloud, no internet, no API keys.

0.0.2 #

  • Updated example app with streaming UI and ChatML template formatting.
  • Fixed heavy operations (model load/generation) running on UI thread — now reliably using background Isolates.
  • Added logo and usage instructions to README.md.

0.0.1 #

  • Added PicoLM class with load(), generate(), and generateFull().
  • Background isolate support for load() and generate().
  • Support for GGUF model files.
  • JSON grammar mode (setJsonMode).
  • Streaming token output.
  • iOS, Android, and macOS platform support.
0
likes
150
points
109
downloads

Publisher

unverified uploader

Weekly Downloads

On-device LLM inference engine for Flutter. Run LLaMA-architecture models via Dart FFI — no cloud, no internet, no API keys.

Repository (GitHub)
View/report issues

Documentation

API reference

License

MIT (license)

Dependencies

flutter

More

Packages that depend on picolm_flutter

Packages that implement picolm_flutter