dort

ONNX Runtime (ort) for Dart.

Requires Rust toolchain (rustup). The native library compiles automatically via Dart Native Assets on first dart run / flutter build.

Usage

import 'package:dort/dort.dart';

final session = Session.load('model.onnx');

final outputs = session.run([
  Tensor.i64('input_ids', tokenIds, [1, seqLen]),
  Tensor('hidden_states', floatData, [1, 256]),
]);

final result = outputs.first; // Float32List
session.dispose();