openvino_genai 0.1.0
openvino_genai: ^0.1.0 copied to clipboard
On-device LLM inference for Flutter via Intel OpenVINO GenAI: streaming chat completion on CPU/GPU with hardened load and fallback behaviour. Windows x64; unofficial.
Use this package as a library
Depend on it
Run this command:
With Flutter:
$ flutter pub add openvino_genaiThis will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):
dependencies:
openvino_genai: ^0.1.0Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.
Import it
Now in your Dart code, you can use:
import 'package:openvino_genai/openvino_genai.dart';