CuaAction class

A single parsed CUA action. Coordinates are already scaled to the caller's viewport. text is the action's primary string argument, keyed by type: TYPE->text, VISIT_URL->url, WEB_SEARCH->query, TERMINATE->answer, ASK_USER/READ_PAGE_ANSWER->question, PAUSE_MEMORIZE->fact, KEY->space-joined keys. reasoning holds any chain-of-thought preceding the tool_call.

COORDINATE CONTRACT: x/y are integers in the SAME pixel space as the viewport you passed to parse_action, origin at the TOP-LEFT. That viewport must be the pixel dimensions of the exact image you handed to the VLM — if you downscaled the screenshot before sending it, pass the downscaled dimensions. On a DPR-2/3/4 display, passing logical points while sending a physical-pixel screenshot offsets every click by that factor, silently (see RunanywhereAI/runanywhere-ios ComputerUseAgentViewModel.swift for the correct computation). parse_action has already rescaled out of the profile's own space (1000x1000 for fara), so no further scaling is ever correct.

LEFT_CLICK_DRAG: x/y are the drag DESTINATION only. Fara emits no origin (it drags from the current cursor), and a touch screen has no cursor, so the HOST must supply the press point — typically the last MOUSE_MOVE target.

LENGTH: text and reasoning are TRUNCATED at 2047 bytes on a UTF-8 lead byte by the fixed C buffers behind them (rac_cua_action_t.text2048); no field records that truncation happened. This also caps a TERMINATE answer.

Available extensions

GeneratedMessageGenericExtensions

Constructors

CuaAction({CuaActionType? type, int? x, int? y, int? scrollX, int? scrollY, double? waitSeconds, String? text, String? reasoning, bool? isValid}): factory
CuaAction.fromBuffer(List<int> data, [ExtensionRegistry registry = $pb.ExtensionRegistry.EMPTY]): factory
CuaAction.fromJson(String json, [ExtensionRegistry registry = $pb.ExtensionRegistry.EMPTY]): factory

Properties

hashCode → int: Calculates a hash code based on the contents of the protobuf.
no setterinherited
info_ → BuilderInfo: no setter
isFrozen → bool: Returns true if this message is marked read-only. Otherwise false.
no setterinherited
isValid ↔ bool: getter/setter pair
reasoning ↔ String: getter/setter pair
runtimeType → Type: A representation of the runtime type of the object.
no setterinherited
scrollX ↔ int: HSCROLL/SCROLL axis split. Value is the model's raw pixels output, copied verbatim per axis — the sign is UNVERIFIED against any real device trace, so no direction convention is asserted here.
getter/setter pair
scrollY ↔ int: getter/setter pair
text ↔ String: getter/setter pair
type ↔ CuaActionType: getter/setter pair
unknownFields → UnknownFieldSet: no setterinherited
waitSeconds ↔ double: WAIT: fractional seconds. Clamped by commons to 0, 100 because the value comes from untrusted model output; an unbounded parse would wedge the agent loop. 100s is a RunAnywhere-chosen ceiling, not inherited from any vendor API.
getter/setter pair
x ↔ int: getter/setter pair
y ↔ int: getter/setter pair

Methods

addExtension(Extension extension, Object? value) → void: Adds an extension field value to a repeated field.
inherited
check() → void: Throws a StateError if the message has required fields without a value.
inherited
clear() → void: Clears all data that was set in this message.
inherited
clearExtension(Extension extension) → void: Clears an extension field and also removes the extension.
inherited
clearField(int tagNumber) → void: Clears the contents of a given field.
inherited
clearIsValid() → void
clearReasoning() → void
clearScrollX() → void
clearScrollY() → void
clearText() → void
clearType() → void
clearWaitSeconds() → void
clearX() → void
clearY() → void
clone() → CuaAction: Creates a deep copy of the fields in this message.
copyWith(void updates(CuaAction)) → CuaAction: Apply updates to a copy of this message.
createEmptyInstance() → CuaAction: Creates an empty instance of the same message type as this.
deepCopy() → T: Available on T, provided by the GeneratedMessageGenericExtensions extension
Returns a writable deep copy of this message.
extensionsAreInitialized() → bool: inherited
freeze() → GeneratedMessage: Make this message read-only.
inherited
getDefaultForField(int tagNumber) → dynamic: Returns the default value for the given field.
inherited
getExtension(Extension extension) → dynamic: Returns the value of extension.
inherited
getField(int tagNumber) → dynamic: Returns the value of the field associated with tagNumber, or the default value if it is not set.
inherited
getFieldOrNull(int tagNumber) → dynamic: Returns the value of a field, ignoring any defaults.
inherited
getTagNumber(String fieldName) → int?: inherited
hasExtension(Extension extension) → bool: Returns true if a value of extension is present.
inherited
hasField(int tagNumber) → bool: Whether this message has a field associated with tagNumber.
inherited
hasIsValid() → bool
hasReasoning() → bool
hasRequiredFields() → bool: Whether the message has required fields.
inherited
hasScrollX() → bool
hasScrollY() → bool
hasText() → bool
hasType() → bool
hasWaitSeconds() → bool
hasX() → bool
hasY() → bool
isInitialized() → bool: Whether all required fields in the message and embedded messages are set.
inherited
mergeFromBuffer(List<int> input, [ExtensionRegistry extensionRegistry = ExtensionRegistry.EMPTY]) → void: Merges serialized protocol buffer data into this message.
inherited
mergeFromCodedBufferReader(CodedBufferReader input, [ExtensionRegistry extensionRegistry = ExtensionRegistry.EMPTY]) → void: Same as mergeFromBuffer, but takes a CodedBufferReader input.
inherited
mergeFromJson(String data, [ExtensionRegistry extensionRegistry = ExtensionRegistry.EMPTY]) → void: Merges field values from data, a JSON object, encoded as described by GeneratedMessage.writeToJson.
inherited
mergeFromJsonMap(Map<String, dynamic> json, [ExtensionRegistry extensionRegistry = ExtensionRegistry.EMPTY]) → void: Merges field values from a JSON object represented as a Dart map.
inherited
mergeFromMessage(GeneratedMessage other) → void: Merges the contents of the other into this message.
inherited
mergeFromProto3Json(Object? json, {TypeRegistry typeRegistry = const TypeRegistry.empty(), bool ignoreUnknownFields = false, bool supportNamesWithUnderscores = true, bool permissiveEnums = false}) → void: Merges field values from json, a JSON object using proto3 encoding.
inherited
mergeUnknownFields(UnknownFieldSet unknownFieldSet) → void: inherited
noSuchMethod(Invocation invocation) → dynamic: Invoked when a nonexistent method or property is accessed.
inherited
rebuild(void updates(T)) → T: Available on T, provided by the GeneratedMessageGenericExtensions extension
Apply updates to a copy of this message.
setExtension(Extension extension, Object value) → void: Sets the value of a non-repeated extension field to value.
inherited
setField(int tagNumber, Object value) → void: Sets the value of a field by its tagNumber.
inherited
toBuilder() → GeneratedMessage: Creates a writable, shallow copy of this message.
inherited
toDebugString() → String: Returns a String representation of this message.
inherited
toProto3Json({TypeRegistry typeRegistry = const TypeRegistry.empty()}) → Object?: Returns an Object representing Proto3 JSON serialization of this.
inherited
toString() → String: Returns a String representation of this message.
inherited
writeToBuffer() → Uint8List: Serialize the message as the protobuf binary format.
inherited
writeToCodedBufferWriter(CodedBufferWriter output) → void: Same as writeToBuffer, but serializes to the given CodedBufferWriter.
inherited
writeToJson() → String: Returns a JSON string that encodes this message.
inherited
writeToJsonMap() → Map<String, dynamic>: Returns the JSON encoding of this message as a Dart Map.
inherited

Operators

operator ==(Object other) → bool: The equality operator.
inherited

Static Methods

create() → CuaAction
getDefault() → CuaAction