SessionOptionsAppendExecutionProvider_CUDA_V2 property

Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtSessionOptions> options, Pointer<OrtCUDAProviderOptionsV2> cuda_options)>> SessionOptionsAppendExecutionProvider_CUDA_V2
getter/setter pair

\brief Append CUDA execution provider to the session options

If CUDA is not available (due to a non CUDA enabled build), this function will return failure.

This is slightly different from OrtApi::SessionOptionsAppendExecutionProvider_CUDA, it takes an ::OrtCUDAProviderOptions which is publicly defined. This takes an opaque ::OrtCUDAProviderOptionsV2 which must be created with OrtApi::CreateCUDAProviderOptions.

For OrtApi::SessionOptionsAppendExecutionProvider_CUDA, the user needs to instantiate ::OrtCUDAProviderOptions as well as allocate/release buffers for some members of ::OrtCUDAProviderOptions. Here, OrtApi::CreateCUDAProviderOptions and Ortapi::ReleaseCUDAProviderOptions will do the memory management for you.

\paramin options \paramin cuda_options

\snippet{doc} snippets.dox OrtStatus Return Value

\since Version 1.11.

Implementation

external ffi.Pointer<
  ffi.NativeFunction<
    OrtStatusPtr Function(
      ffi.Pointer<OrtSessionOptions> options,
      ffi.Pointer<OrtCUDAProviderOptionsV2> cuda_options,
    )
  >
>
SessionOptionsAppendExecutionProvider_CUDA_V2;