runanywhere_qhexrt 0.20.18
runanywhere_qhexrt: ^0.20.18 copied to clipboard
On-device NPU acceleration backend for RunAnywhere — LLM/VLM/STT/TTS on Qualcomm Snapdragon Hexagon (V75/V79/V81), Android arm64.
runanywhere_qhexrt #
Qualcomm Hexagon NPU backend for the RunAnywhere Flutter SDK — on-device LLM, VLM, STT, and TTS on Snapdragon V75/V79/V81 NPUs. Android arm64-v8a only.
Installation #
dependencies:
runanywhere: 0.20.11
runanywhere_qhexrt: 0.20.11
See the Flutter SDK README for Android setup.
Usage #
import 'package:runanywhere/runanywhere.dart';
import 'package:runanywhere_qhexrt/qhexrt.dart';
await RunAnywhere.initialize();
final npu = QHexRT.probeNpu(); // safe on any device
if (npu.supported) {
await QHexRT.register();
}
// Register, download, load, and infer via core RunAnywhere APIs
See the Flutter SDK README for full examples.
Requirements #
- Android
arm64-v8a - Qualcomm Snapdragon device with Hexagon V75, V79, or V81 NPU
Support #
License #
Proprietary. See LICENSE.