RunOptionsSetSyncStream property

Pointer<NativeFunction<Void Function(Pointer<OrtRunOptions> options, Pointer<OrtSyncStream> sync_stream)>> RunOptionsSetSyncStream

\brief Sets OrtSyncStream for the run options

OrtSyncStream is used to synchronize the execution of the model run for the device of the stream. It overrides the existing stream for the duration of the Run(). The stream instance must be alive for the duration of the Run() call.

\paramin options \paramin sync_stream The synchronization stream. Pass nullptr to clear previous setting.

\since 1.24

Implementation

external ffi.Pointer<
  ffi.NativeFunction<
    ffi.Void Function(
      ffi.Pointer<OrtRunOptions> options,
      ffi.Pointer<OrtSyncStream> sync_stream,
    )
  >
>
RunOptionsSetSyncStream;