flutter_gemma_onnx 0.1.0 copy "flutter_gemma_onnx: ^0.1.0" to clipboard
flutter_gemma_onnx: ^0.1.0 copied to clipboard

ONNX Runtime GenAI on-device inference engine for flutter_gemma (5 native platforms, no web). Opt-in InferenceEngineProvider for ORT-GenAI model directories.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add flutter_gemma_onnx

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  flutter_gemma_onnx: ^0.1.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:flutter_gemma_onnx/flutter_gemma_onnx.dart';
0
likes
150
points
0
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

ONNX Runtime GenAI on-device inference engine for flutter_gemma (5 native platforms, no web). Opt-in InferenceEngineProvider for ORT-GenAI model directories.

Homepage
Repository (GitHub)
View/report issues

Topics

#gemma #llm #onnx #onnxruntime #on-device

License

MIT (license)

Dependencies

code_assets, crypto, ffi, flutter, flutter_gemma, flutter_gemma_embeddings, hooks, mutex

More

Packages that depend on flutter_gemma_onnx