offload property

OffloadConfig? offload
final

v3.0+ — distributed inference / device offload.

When offload.enabled is true, the native side runs mDNS discovery (and optionally a rendezvous WebSocket) to find peer dvai-bridge instances and offloads inference requests when the local device can't serve the model fast enough.

Pairing-request UI is surfaced via DVAIBridge.pairingRequests — the function-typed onPairingRequest callback of the JS-side OffloadConfig isn't representable across the Pigeon channel, so Dart consumers listen to a Stream of PairingRequest values instead.

Implementation

final OffloadConfig? offload;