OrtExternalResourceImporterImpl class final

\brief Struct that an EP implements for external resource import (memory + semaphore import).

This capability object provides methods for importing external GPU memory and semaphores for zero-copy import. EPs that support D3D12, CUDA, HIP, or Vulkan external resource APIs can implement this interface.

\since Version 1.24.

Inheritance
Implemented types
Available extensions

Properties

address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
CanImportMemory ↔ Pointer<NativeFunction<Bool Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, UnsignedInt handle_type)>>
\brief Check if the implementation can import external memory of the given handle type.
getter/setter pair
CanImportSemaphore ↔ Pointer<NativeFunction<Bool Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, UnsignedInt type)>>
\brief Check if the implementation can import external semaphores of the given type.
getter/setter pair
CreateTensorFromMemory ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalMemoryHandle> mem_handle, Pointer<OrtExternalTensorDescriptor> tensor_desc, Pointer<Pointer<OrtValue>> out_tensor)>>
\brief Create a tensor backed by imported external memory.
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
ImportMemory ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalMemoryDescriptor> desc, Pointer<Pointer<OrtExternalMemoryHandle>> out_handle)>>
\brief Import external memory.
getter/setter pair
ImportSemaphore ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalSemaphoreDescriptor> desc, Pointer<Pointer<OrtExternalSemaphoreHandle>> out_handle)>>
\brief Import an external semaphore.
getter/setter pair
ort_version_supported ↔ int
< Must be initialized to ORT_API_VERSION
getter/setter pair
Release ↔ Pointer<NativeFunction<Void Function(Pointer<OrtExternalResourceImporterImpl> this_ptr)>>
\brief Release the OrtExternalResourceImporterImpl instance.
getter/setter pair
ReleaseMemory ↔ Pointer<NativeFunction<Void Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalMemoryHandle> handle)>>
\brief Release an imported external memory handle.
getter/setter pair
ReleaseSemaphore ↔ Pointer<NativeFunction<Void Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalSemaphoreHandle> handle)>>
\brief Release an imported external semaphore handle.
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
SignalSemaphore ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalSemaphoreHandle> handle, Pointer<OrtSyncStream> stream, Uint64 value)>>
\brief Signal an external semaphore from the EP's stream.
getter/setter pair
WaitSemaphore ↔ Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtExternalResourceImporterImpl> this_ptr, Pointer<OrtExternalSemaphoreHandle> handle, Pointer<OrtSyncStream> stream, Uint64 value)>>
\brief Wait on an external semaphore on the EP's stream.
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited