TfLiteGpuDelegateOptionsV2 class
IMPORTANT: Always use TfLiteGpuDelegateOptionsV2Default() method to create new instance of TfLiteGpuDelegateOptionsV2, otherwise every new added option may break inference.
- Inheritance
- Implemented types
- Available extensions
Constructors
Properties
-
address
→ Pointer<
T> -
Available on T, provided by the StructAddress extension
The memory address of the underlying data.no setter - experimental_flags ↔ int
-
Bitmask flags. See the comments in TfLiteGpuExperimentalFlags.
getter/setter pair
- hashCode → int
-
The hash code for this object.
no setterinherited
- inference_preference ↔ int
-
Preference is defined in TfLiteGpuInferenceUsage.
getter/setter pair
- inference_priority1 ↔ int
-
Ordered priorities provide better control over desired semantics,
where priority(n) is more important than priority(n+1), therefore,
each time inference engine needs to make a decision, it uses
ordered priorities to do so.
For example:
MAX_PRECISION at priority1 would not allow to decrease precision,
but moving it to priority2 or priority3 would result in F16 calculation.
getter/setter pair
- inference_priority2 ↔ int
-
getter/setter pair
- inference_priority3 ↔ int
-
getter/setter pair
- is_precision_loss_allowed ↔ int
-
When set to zero, computations are carried out in maximal possible
precision. Otherwise, the GPU may quantify tensors, downcast values,
process in FP16 to increase performance. For most models precision loss is
warranted.
OBSOLETE: to be removedgetter/setter pair - max_delegated_partitions ↔ int
-
A graph could have multiple partitions that can be delegated to the GPU.
This limits the maximum number of partitions to be delegated. By default,
it's set to 1 in TfLiteGpuDelegateOptionsV2Default().
getter/setter pair
-
model_token
↔ Pointer<
Utf8> -
The unique nul-terminated token string that acts as a 'namespace' for
all serialization entries.
Should be unique to a particular model (graph & constants).
For an example of how to generate this from a TFLite model, see
StrFingerprint() in lite/delegates/serialization.h.
getter/setter pair
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
-
serialization_dir
↔ Pointer<
Utf8> -
The nul-terminated directory to use for serialization.
Whether serialization actually happens or not is dependent on backend used
and validity of this directory.
Set to nullptr in TfLiteGpuDelegateOptionsV2Default(), which implies the
delegate will not try serialization.
getter/setter pair
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited