OrtEp class final

\brief The OrtEp struct provides functions to implement for an execution provider. \since Version 1.22.

Inheritance
Implemented types
Available extensions

Constructors

OrtEp()

Properties

address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
Compile ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<Pointer<OrtGraph>> graphs, Pointer<Pointer<OrtNode>> fused_nodes, Size count, Pointer<Pointer<OrtNodeComputeInfo>> node_compute_infos, Pointer<Pointer<OrtNode>> ep_context_nodes)>>
\brief Compile OrtGraph instances assigned to the OrtEp. Implementer must set a OrtNodeComputeInfo instance for each OrtGraph in order to define its computation function.
getter/setter pair
CreateAllocator ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<OrtMemoryInfo> memory_info, Pointer<Pointer<OrtAllocator>> allocator)>>
\brief Create an OrtAllocator for the given OrtMemoryInfo for an OrtSession.
getter/setter pair
CreateSyncStreamForDevice ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<OrtMemoryDevice> memory_device, Pointer<Pointer<OrtSyncStreamImpl>> stream)>>
\brief Create a synchronization stream for the given memory device for an OrtSession.
getter/setter pair
GetCapability ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<OrtGraph> graph, Pointer<OrtEpGraphSupportInfo> graph_support_info)>>
\brief Get information about the nodes supported by the OrtEp instance.
getter/setter pair
GetCompiledModelCompatibilityInfo ↔ Pointer<NativeFunction<Pointer<Char> Function(Pointer<OrtEp> this_ptr, Pointer<OrtGraph> graph)>>
\brief Get a string with details about the EP stack used to produce a compiled model.
getter/setter pair
GetKernelRegistry ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<Pointer<OrtKernelRegistry>> kernel_registry)>>
\brief Gets the execution provider's kernel registry, if any.
getter/setter pair
GetName ↔ Pointer<NativeFunction<Pointer<Char> Function(Pointer<OrtEp> this_ptr)>>
\brief Get the execution provider name.
getter/setter pair
GetPreferredDataLayout ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<UnsignedInt> preferred_data_layout)>>
\brief Get the EP's preferred data layout.
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
IsConcurrentRunSupported ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<Bool> is_supported)>>
\brief Gets whether the execution provider supports concurrent run calls made on the session.
getter/setter pair
OnRunEnd ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<OrtRunOptions> run_options, Bool sync_stream)>>
\brief Called by ORT to notify the EP of the end of a run.
getter/setter pair
OnRunStart ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<OrtRunOptions> run_options)>>
\brief Called by ORT to notify the EP of the start of a run.
getter/setter pair
ort_version_supported ↔ int
\brief The ONNX Runtime version the execution provider was compiled with.
getter/setter pair
ReleaseNodeComputeInfos ↔ Pointer<NativeFunction<Void Function(Pointer<OrtEp> this_ptr, Pointer<Pointer<OrtNodeComputeInfo>> node_compute_infos, Size num_node_compute_infos)>>
\brief Release OrtNodeComputeInfo instances.
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
SetDynamicOptions ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<Pointer<Char>> option_keys, Pointer<Pointer<Char>> option_values, Size num_options)>>
\brief Set dynamic options on this EP.
getter/setter pair
ShouldConvertDataLayoutForOp ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEp> this_ptr, Pointer<Char> domain, Pointer<Char> op_type, UnsignedInt target_data_layout, Pointer<Int> should_convert)>>
\brief Given an op with domain domain and type op_type, determine whether an associated node's data layout should be converted to target_data_layout. If the EP prefers a non-default data layout (see GetPreferredDataLayout()), this function will be called during layout transformation with target_data_layout set to the EP's preferred data layout.
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited