bindings/onnxruntime_generated library
Classes
- OnnxRuntimeBindings
-
Bindings for
headers/onnxruntime_c_api.h. Regenerate bindings withdart run ffigen --config ffigen.yaml. - OrtAllocator
- \brief Memory allocation interface
- OrtApi
- \brief The C API
- OrtApiBase
- \brief The helper interface to get the right version of OrtApi
- OrtArenaCfg
- OrtCANNProviderOptions
- OrtCompileApi
- \brief The OrtCompileApi struct provides functions to compile ONNX models.
- OrtCUDAProviderOptions
- \brief CUDA Provider Options
- OrtCUDAProviderOptionsV2
- OrtCustomHandleType
- OrtCustomOp
- The OrtCustomOp structure defines a custom op's schema and its kernel callbacks. The callbacks are filled in by the implementor of the custom op.
- OrtCustomOpDomain
- OrtDataTransferImpl
- \brief Struct that an EP implements for IDataTransfer to copy between devices it uses and CPU.
- OrtDataType
- OrtDeviceEpIncompatibilityDetails
- OrtDnnlProviderOptions
- OrtEnv
- \addtogroup Global ONNX Runtime C API @{ / // The actual types defined have an Ort prefix
- OrtEnvCreationOptions
- \brief Configuration options for creating an OrtEnv.
- OrtEp
- \brief The OrtEp struct provides functions to implement for an execution provider. \since Version 1.22.
- OrtEpApi
- \brief The OrtEpApi struct provides functions that are relevant to the implementation of an execution provider.
- OrtEpAssignedNode
- OrtEpAssignedSubgraph
- OrtEpDevice
- OrtEpFactory
- \brief The OrtEpFactory provides functions to create and manage execution providers. \since Version 1.22.
- OrtEpGraphSupportInfo
- OrtExternalInitializerInfo
- OrtExternalMemoryDescriptor
- \brief Descriptor for importing external memory.
- OrtExternalMemoryHandle
- \brief Base struct for imported external memory handles.
- OrtExternalResourceImporter
- OrtExternalResourceImporterImpl
- \brief Struct that an EP implements for external resource import (memory + semaphore import).
- OrtExternalSemaphoreDescriptor
- \brief Descriptor for importing external semaphores.
- OrtExternalSemaphoreHandle
- \brief Base struct for imported external semaphore handles.
- OrtExternalTensorDescriptor
- \brief Descriptor for creating a tensor from imported external memory.
- OrtGraph
- OrtHardwareDevice
- OrtInteropApi
- \brief The OrtInteropApi struct provides functions for external resource interop with execution providers.
- OrtIoBinding
- OrtKernelContext
- OrtKernelDef
- OrtKernelDefBuilder
- OrtKernelImpl
- \brief Contains functions that an OrtEp implements to specify the computation for an operator kernel. \since Version 1.24.
- OrtKernelInfo
- OrtKernelRegistry
- Opaque types for kernel-based EPs
- OrtKeyValuePairs
- OrtLogger
- OrtLoopKernelHelper
- \brief Contains helper functions for a Loop OrtKernelImpl created via OrtEpApi::CreateLoopKernel. \since Version 1.24.
- OrtLoraAdapter
- OrtMapTypeInfo
- OrtMemoryDevice
- OrtMemoryInfo
- OrtMIGraphXProviderOptions
- \brief MIGraphX Provider Options
- OrtModel
- OrtModelCompilationOptions
- OrtModelEditorApi
- \brief The OrtModelEditorApi struct provides functions to create or edit an ONNX model.
- OrtModelMetadata
- OrtNode
- OrtNodeComputeContext
- OrtNodeComputeInfo
- \brief The OrtNodeComputeInfo struct provides functions that an OrtEp implements to specify the compute function for a compiled OrtGraph instance. \since Version 1.23.
- OrtNodeFusionOptions
- \brief The OrtNodeFusionOptions struct specifies options for fusing nodes supported by an execution provider.
- OrtNvTensorRtRtxProviderOptions
- OrtOp
- OrtOpAttr
- OrtOpenVINOProviderOptions
- \brief OpenVINO Provider Options \brief This Struct is frozen since ORT 1.13.0. Its maintained part of Legacy API for compatibility. \brief For latest OpenVINO Provider Options update to the ProviderOptions map. \brief Latest OpenVINO Provider Options are listed in the \htmlonly onnxruntime document. \endhtmlonly \see OrtApi::SessionOptionsAppendExecutionProvider()
- OrtOptionalTypeInfo
- OrtPrepackedWeightsContainer
- OrtROCMProviderOptions
- \brief ROCM Provider Options
- OrtRunOptions
- OrtScanKernelHelper
- \brief Contains helper functions for a Scan OrtKernelImpl created via OrtEpApi::CreateScanKernel. \since Version 1.24.
- OrtSequenceTypeInfo
- OrtSession
- OrtSessionOptions
- OrtShapeInferContext
- OrtStatus
- OrtSyncNotificationImpl
- \brief Struct that an EP implements for Stream Notifications.
- OrtSyncStream
- OrtSyncStreamImpl
- \brief Struct that an EP implements if it wishes to implement Stream support.
- OrtTensorRTProviderOptions
- \brief TensorRT Provider Options
- OrtTensorRTProviderOptionsV2
- OrtTensorTypeAndShapeInfo
- OrtThreadingOptions
- OrtThreadPoolParams
- OrtTrainingApi
- OrtTypeInfo
- OrtValue
- OrtValueInfo
Enums
- ExecutionMode
- GraphOptimizationLevel
- \brief Graph optimization level
- NNAPIFlags
- NNAPIFlags are bool options we want to set for NNAPI EP This enum is defined as bit flags, and cannot have negative value To generate an uint32_t nnapi_flags for using with OrtSessionOptionsAppendExecutionProvider_Nnapi below, uint32_t nnapi_flags = 0; nnapi_flags |= NNAPI_FLAG_USE_FP16;
- ONNXTensorElementDataType
- Copied from TensorProto::DataType Currently, Ort doesn't support complex64, complex128
- ONNXType
- Synced with onnx TypeProto oneof
- OrtAllocatorType
- OrtCompileApiFlags
- \brief Flags representing options to enable when compiling a model.
- OrtCompiledModelCompatibility
- Public enum for compiled model compatibility across EPs.
- OrtCudnnConvAlgoSearch
- \brief Algorithm to use for cuDNN Convolution Op
- OrtCustomOpInputOutputCharacteristic
- Specifies some characteristics of inputs/outputs of custom ops: Specify if the inputs/outputs are one of:
- OrtDeviceEpIncompatibilityReason
- \brief Reasons why an execution provider might not be compatible with a device
- OrtDeviceMemoryType
- \brief This matches OrtDevice::MemoryType values
- OrtEpDataLayout
- \brief The data layout type.
- OrtErrorCode
- OrtExecutionProviderDevicePolicy
- \brief These are the default EP selection policies used by ORT when doing automatic EP selection.
- OrtExternalMemoryHandleType
- \brief External memory handle type for importing GPU resources.
- OrtExternalSemaphoreType
- \brief External semaphore type for GPU synchronization.
- OrtHardwareDeviceType
- OrtLanguageProjection
- \brief Language projection identifiers /see OrtApi::SetLanguageProjection
- OrtLoggingLevel
- \brief Logging severity levels
- OrtMemoryInfoDeviceType
- \brief This mimics OrtDevice type constants so they can be returned in the API
- OrtMemType
- \brief Memory types for allocated memory, execution provider specific types should be extended in each provider. / // Whenever this struct is updated, please also update the MakeKey function in onnxruntime / core / framework / execution_provider.cc
- OrtOpAttrType
- OrtSparseFormat
- These types are synced with internal SparseFormatFlags
- OrtSparseIndicesFormat
- Enum allows to query sparse tensor indices
Constants
- ORT_API_VERSION → const int
- ORT_FILE → const String
Typedefs
-
DartEpSelectionDelegateFunction
= Pointer<
OrtStatus> Function(Pointer<Pointer< ep_devices, int num_devices, Pointer<OrtEpDevice> >OrtKeyValuePairs> model_metadata, Pointer<OrtKeyValuePairs> runtime_metadata, Pointer<Pointer< selected, int max_selected, Pointer<OrtEpDevice> >Size> num_selected, Pointer<Void> state) - DartOrtCustomJoinThreadFnFunction = void Function(OrtCustomThreadHandle ort_custom_thread_handle)
-
DartOrtLoggingFunctionFunction
= void Function(Pointer<
Void> param, OrtLoggingLevel severity, Pointer<Char> category, Pointer<Char> logid, Pointer<Char> code_location, Pointer<Char> message) -
DartOrtThreadWorkerFnFunction
= void Function(Pointer<
Void> ort_worker_fn_param) -
DartOrtWriteBufferFuncFunction
= Pointer<
OrtStatus> Function(Pointer<Void> state, Pointer<Void> buffer, int buffer_num_bytes) -
DartRunAsyncCallbackFnFunction
= void Function(Pointer<
Void> user_data, Pointer<Pointer< outputs, int num_outputs, OrtStatusPtr status)OrtValue> > -
EpSelectionDelegate
= Pointer<
NativeFunction< EpSelectionDelegateFunction> > - \brief Delegate to allow providing custom OrtEpDevice selection logic
-
EpSelectionDelegateFunction
= Pointer<
OrtStatus> Function(Pointer<Pointer< ep_devices, Size num_devices, Pointer<OrtEpDevice> >OrtKeyValuePairs> model_metadata, Pointer<OrtKeyValuePairs> runtime_metadata, Pointer<Pointer< selected, Size max_selected, Pointer<OrtEpDevice> >Size> num_selected, Pointer<Void> state) -
OrtCustomCreateThreadFn
= Pointer<
NativeFunction< OrtCustomCreateThreadFnFunction> > - \brief Ort custom thread creation function
-
OrtCustomCreateThreadFnFunction
= OrtCustomThreadHandle Function(Pointer<
Void> ort_custom_thread_creation_options, OrtThreadWorkerFn ort_thread_worker_fn, Pointer<Void> ort_worker_fn_param) -
OrtCustomJoinThreadFn
= Pointer<
NativeFunction< OrtCustomJoinThreadFnFunction> > - \brief Custom thread join function
- OrtCustomJoinThreadFnFunction = Void Function(OrtCustomThreadHandle ort_custom_thread_handle)
-
OrtCustomThreadHandle
= Pointer<
OrtCustomHandleType> -
OrtGetInitializerLocationFunc
= Pointer<
NativeFunction< OrtGetInitializerLocationFuncFunction> > - \brief Function called by ORT to allow user to specify how an initializer should be saved, that is, either written to an external file or stored within the model. ORT calls this function for every initializer when generating a model.
-
OrtGetInitializerLocationFuncFunction
= Pointer<
OrtStatus> Function(Pointer<Void> state, Pointer<Char> initializer_name, Pointer<OrtValue> initializer_value, Pointer<OrtExternalInitializerInfo> external_info, Pointer<Pointer< new_external_info)OrtExternalInitializerInfo> > -
OrtKernelCreateFunc
= Pointer<
NativeFunction< OrtKernelCreateFuncFunction> > - \brief Type definition for a function that creates an OrtKernelImpl instance for an operator kernel.
-
OrtKernelCreateFuncFunction
= Pointer<
OrtStatus> Function(Pointer<Void> kernel_create_func_state, Pointer<OrtKernelInfo> info, Pointer<Pointer< kernel_out)OrtKernelImpl> > -
OrtLoggingFunction
= Pointer<
NativeFunction< OrtLoggingFunctionFunction> > -
OrtLoggingFunctionFunction
= Void Function(Pointer<
Void> param, UnsignedInt severity, Pointer<Char> category, Pointer<Char> logid, Pointer<Char> code_location, Pointer<Char> message) -
OrtStatusPtr
= Pointer<
OrtStatus> -
OrtThreadWorkerFn
= Pointer<
NativeFunction< OrtThreadWorkerFnFunction> > - \brief Thread work loop function
-
OrtThreadWorkerFnFunction
= Void Function(Pointer<
Void> ort_worker_fn_param) -
OrtWriteBufferFunc
= Pointer<
NativeFunction< OrtWriteBufferFuncFunction> > - \brief Function called by ORT to write a buffer to a custom destination (e.g., file, stream, etc.).
-
OrtWriteBufferFuncFunction
= Pointer<
OrtStatus> Function(Pointer<Void> state, Pointer<Void> buffer, Size buffer_num_bytes) -
RegisterCustomOpsFn
= Pointer<
NativeFunction< RegisterCustomOpsFnFunction> > -
RegisterCustomOpsFnFunction
= Pointer<
OrtStatus> Function(Pointer<OrtSessionOptions> options, Pointer<OrtApiBase> api) -
RunAsyncCallbackFn
= Pointer<
NativeFunction< RunAsyncCallbackFnFunction> > - \brief Callback function for RunAsync
-
RunAsyncCallbackFnFunction
= Void Function(Pointer<
Void> user_data, Pointer<Pointer< outputs, Size num_outputs, OrtStatusPtr status)OrtValue> >