OrtCUDAProviderOptions class final

\brief CUDA Provider Options

\see OrtApi::SessionOptionsAppendExecutionProvider_CUDA

Inheritance
Implemented types
Available extensions

Constructors

OrtCUDAProviderOptions()

Properties

address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
arena_extend_strategy ↔ int
\brief Strategy used to grow the memory arena 0 = kNextPowerOfTwo
1 = kSameAsRequested
Defaults to 0. \note If a ::OrtArenaCfg has been applied, it will override this field
getter/setter pair
no setter
cudnn_conv_algo_searchAsInt ↔ int
\brief CUDA Convolution algorithm search configuration. See enum OrtCudnnConvAlgoSearch for more details. Defaults to OrtCudnnConvAlgoSearchExhaustive.
getter/setter pair
default_memory_arena_cfg ↔ Pointer<OrtArenaCfg>
\brief CUDA memory arena configuration parameters
getter/setter pair
device_id ↔ int
\brief CUDA device Id Defaults to 0.
getter/setter pair
do_copy_in_default_stream ↔ int
\brief Flag indicating if copying needs to take place on the same stream as the compute stream in the CUDA EP 0 = Use separate streams for copying and compute. 1 = Use the same stream for copying and compute. Defaults to 1. WARNING: Setting this to 0 may result in data races for some models. Please see issue #4829 for more details.
getter/setter pair
gpu_mem_limit ↔ int
\brief CUDA memory limit (To use all possible memory pass in maximum size_t) Defaults to SIZE_MAX. \note If a ::OrtArenaCfg has been applied, it will override this field
getter/setter pair
has_user_compute_stream ↔ int
\brief Flag indicating if there is a user provided compute stream Defaults to 0.
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
tunable_op_enable ↔ int
\brief Enable TunableOp for using. Set it to 1/0 to enable/disable TunableOp. Otherwise, it is disabled by default. This option can be overridden by environment variable ORT_CUDA_TUNABLE_OP_ENABLE.
getter/setter pair
tunable_op_max_tuning_duration_ms ↔ int
\brief Max tuning duration time limit for each instance of TunableOp. Defaults to 0 to disable the limit.
getter/setter pair
tunable_op_tuning_enable ↔ int
\brief Enable TunableOp for tuning. Set it to 1/0 to enable/disable TunableOp tuning. Otherwise, it is disabled by default. This option can be overridden by environment variable ORT_CUDA_TUNABLE_OP_TUNING_ENABLE.
getter/setter pair
user_compute_stream ↔ Pointer<Void>
\brief User provided compute stream. If provided, please set has_user_compute_stream to 1.
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited