SparkOptions class - bigquery library

Constructors

SparkOptions({Input<List<String>>? archiveUris, Input<String>? connection, Input<String>? containerImage, Input<List<String>>? fileUris, Input<List<String>>? jarUris, Input<String>? mainClass, Input<String>? mainFileUri, Input<Map<String, String>>? properties, Input<List<String>>? pyFileUris, Input<String>? runtimeVersion}): Creates a new SparkOptions. archiveUris Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark. connection Fully qualified name of the user-provided Spark connection object. Format: "projects/{project_id}/locations/{location_id}/connections/{connection_id}" containerImage Custom container image for the runtime environment. fileUris Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark. jarUris JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark. mainClass The fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type. mainFileUri The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type. properties Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list. pyFileUris Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark. runtimeVersion Runtime version. If not specified, the default runtime version is used.
const
SparkOptions.fromMap(Map<String, dynamic> map): factory

Properties

archiveUris → Input<List<String>>?: Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
connection → Input<String>?: Fully qualified name of the user-provided Spark connection object. Format: "projects/{project_id}/locations/{location_id}/connections/{connection_id}"
final
containerImage → Input<String>?: Custom container image for the runtime environment.
final
fileUris → Input<List<String>>?: Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
hashCode → int: The hash code for this object.
no setterinherited
jarUris → Input<List<String>>?: JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
final
mainClass → Input<String>?: The fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type.
final
mainFileUri → Input<String>?: The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.
final
properties → Input<Map<String, String>>?: Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list.
final
pyFileUris → Input<List<String>>?: Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.
final
runtimeType → Type: A representation of the runtime type of the object.
no setterinherited
runtimeVersion → Input<String>?: Runtime version. If not specified, the default runtime version is used.
final

Methods

noSuchMethod(Invocation invocation) → dynamic: Invoked when a nonexistent method or property is accessed.
inherited
toMap() → Map<String, dynamic>
toString() → String: A string representation of this object.
inherited

Operators

operator ==(Object other) → bool: The equality operator.
inherited