Skip to main content

onde_inference 1.4.0 copy "onde_inference: ^1.4.0" to clipboard
onde_inference: ^1.4.0 copied to clipboard

On-device LLM inference for Flutter & Dart. Run open-weight models such as Qwen locally with Metal on iOS and macOS, CPU elsewhere. No cloud, no API key.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add onde_inference

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  onde_inference: ^1.4.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:onde_inference/onde_inference.dart';
8
likes
160
points
1.17k
downloads

Documentation

Documentation
API reference

Publisher

verified publisherondeinference.com

Weekly Downloads

On-device LLM inference for Flutter & Dart. Run open-weight models such as Qwen locally with Metal on iOS and macOS, CPU elsewhere. No cloud, no API key.

Homepage
Repository (GitHub)
View/report issues

Topics

#flutter #llm #on-device-ai #offline-ai #ai-inference

License

MIT (license)

Dependencies

flutter, flutter_rust_bridge, freezed_annotation

More

Packages that depend on onde_inference

Packages that implement onde_inference