openvino_genai 0.2.0
openvino_genai: ^0.2.0 copied to clipboard
On-device LLM and vision-language (VLM) inference for Flutter via Intel OpenVINO GenAI: streaming chat and image description on CPU/GPU, hardened load/fallback. Windows x64; unofficial.
Use this package as a library
Depend on it
Run this command:
With Flutter:
$ flutter pub add openvino_genaiThis will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):
dependencies:
openvino_genai: ^0.2.0Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.
Import it
Now in your Dart code, you can use:
import 'package:openvino_genai/openvino_genai.dart';