litertlm_dart 0.0.1-dev.1
litertlm_dart: ^0.0.1-dev.1 copied to clipboard
Dart FFI bindings to Google's LiteRT-LM runtime — run Large Language Models on-device (Gemma, Qwen, Phi and more) with CPU / GPU / NPU acceleration. Pure Dart, no Flutter. Name reserved; first release [...]
Use this package as a library
Depend on it
Run this command:
With Dart:
$ dart pub add litertlm_dartThis will add a line like this to your package's pubspec.yaml (and run an implicit dart pub get):
dependencies:
litertlm_dart: ^0.0.1-dev.1Alternatively, your editor might support dart pub get. Check the docs for your editor to learn more.
Import it
Now in your Dart code, you can use:
import 'package:litertlm_dart/litertlm_dart.dart';