RoutineSparkOptions class
Constructors
-
RoutineSparkOptions({Input<List<String>?>? archiveUris, Input<String?>? connection, Input<String?>? containerImage, Input<List<String>?>? fileUris, Input<List<String>?>? jarUris, Input<String?>? mainClass, Input<String?>? mainFileUri, Input<Map<String, String>?>? properties, Input<List<String>?>? pyFileUris, Input<String?>? runtimeVersion})
-
Creates a new RoutineSparkOptions.
archiveUris Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
connection Fully qualified name of the user-provided Spark connection object.
containerImage Custom container image for the runtime environment.
fileUris Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
jarUris JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
mainClass The fully qualified name of a class in jarUris, for example, com.example.wordcount.
mainFileUri The main file/jar URI of the Spark application.
properties Configuration properties as a set of key/value pairs, which will be passed on to the Spark application.
pyFileUris Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.
runtimeVersion Runtime version. If not specified, the default runtime version is used.
const
-
RoutineSparkOptions.fromMap(Map<String, dynamic> map)
-
factory
Properties
-
archiveUris
→ Input<List<String>?>?
-
Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
-
connection
→ Input<String?>?
-
Fully qualified name of the user-provided Spark connection object.
Format: "projects/{projectId}/locations/{locationId}/connections/{connectionId}"
final
-
containerImage
→ Input<String?>?
-
Custom container image for the runtime environment.
final
-
fileUris
→ Input<List<String>?>?
-
Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
-
hashCode
→ int
-
The hash code for this object.
no setterinherited
-
jarUris
→ Input<List<String>?>?
-
JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
final
-
mainClass
→ Input<String?>?
-
The fully qualified name of a class in jarUris, for example, com.example.wordcount.
Exactly one of mainClass and mainJarUri field should be set for Java/Scala language type.
final
-
mainFileUri
→ Input<String?>?
-
The main file/jar URI of the Spark application.
Exactly one of the definitionBody field and the mainFileUri field must be set for Python.
Exactly one of mainClass and mainFileUri field should be set for Java/Scala language type.
final
-
properties
→ Input<Map<String, String>?>?
-
Configuration properties as a set of key/value pairs, which will be passed on to the Spark application.
For more information, see Apache Spark and the procedure option list.
An object containing a list of "key": value pairs. Example: { "name": "wrench", "mass": "1.3kg", "count": "3" }.
final
-
pyFileUris
→ Input<List<String>?>?
-
Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.
final
-
runtimeType
→ Type
-
A representation of the runtime type of the object.
no setterinherited
-
runtimeVersion
→ Input<String?>?
-
Runtime version. If not specified, the default runtime version is used.
final
