RunAsync property

Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtSession> session, Pointer<OrtRunOptions> run_options, Pointer<Pointer<Char>> input_names, Pointer<Pointer<OrtValue>> input, Size input_len, Pointer<Pointer<Char>> output_names, Size output_names_len, Pointer<Pointer<OrtValue>> output, RunAsyncCallbackFn run_async_callback, Pointer<Void> user_data)>> RunAsync

\brief Run the model asynchronously in a thread owned by intra op thread pool

\paramin session \paramin run_options If nullptr, will use a default ::OrtRunOptions \paramin input_names Array of null terminated UTF8 encoded strings of the input names \paramin input Array of ::OrtValue%s of the input values \paramin input_len Number of elements in the input_names and inputs arrays \paramin output_names Array of null terminated UTF8 encoded strings of the output names \paramin output_names_len Number of elements in the output_names and outputs array \paramout output OrtValue* array of size output_names_len. On calling RunAsync, outputi could either be a null or a pointer to a preallocated OrtValue. Later, the output array will be passed to run_async_callback with all null(s) filled with valid OrtValue pointer(s) allocated by onnxruntime. NOTE: it is customer's duty to finally release the output array and each of its member, regardless of whether the member (OrtValue*) is allocated by onnxruntime or preallocated by the customer. \paramin run_async_callback Callback function on model run completion \paramin user_data User data that pass back to run_async_callback

Implementation

external ffi.Pointer<
  ffi.NativeFunction<
    OrtStatusPtr Function(
      ffi.Pointer<OrtSession> session,
      ffi.Pointer<OrtRunOptions> run_options,
      ffi.Pointer<ffi.Pointer<ffi.Char>> input_names,
      ffi.Pointer<ffi.Pointer<OrtValue>> input,
      ffi.Size input_len,
      ffi.Pointer<ffi.Pointer<ffi.Char>> output_names,
      ffi.Size output_names_len,
      ffi.Pointer<ffi.Pointer<OrtValue>> output,
      RunAsyncCallbackFn run_async_callback,
      ffi.Pointer<ffi.Void> user_data,
    )
  >
>
RunAsync;