dort 0.1.0

ONNX Runtime inference for Dart, powered by the ort Rust crate.

dort

ONNX Runtime (ort) for Dart.

Requires Rust toolchain (rustup). The native library compiles automatically via Dart Native Assets on first dart run / flutter build.

Usage

import 'package:dort/dort.dart';

final session = Session.load('model.onnx');

final outputs = session.run([
  Tensor.i64('input_ids', tokenIds, [1, seqLen]),
  Tensor('hidden_states', floatData, [1, 256]),
]);

final result = outputs.first; // Float32List
session.dispose();