SparkOptionsResponse class
Options for a user-defined Spark routine.
Constructors
-
SparkOptionsResponse({required Input<
List< archiveUris, required Input<String> >String> connection, required Input<String> containerImage, required Input<List< fileUris, required Input<String> >List< jarUris, required Input<String> >String> mainClass, required Input<String> mainFileUri, required Input<Map< properties, required Input<String, String> >List< pyFileUris, required Input<String> >String> runtimeVersion}) -
Creates a new SparkOptionsResponse.
archiveUrisArchive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.connectionFully qualified name of the user-provided Spark connection object. Format:"projects/{project_id}/locations/{location_id}/connections/{connection_id}"containerImageCustom container image for the runtime environment.fileUrisFiles to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.jarUrisJARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.mainClassThe fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type.mainFileUriThe main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.propertiesConfiguration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list.pyFileUrisPython files to be placed on the PYTHONPATH for PySpark application. Supported file types:.py,.egg, and.zip. For more information about Apache Spark, see Apache Spark.runtimeVersionRuntime version. If not specified, the default runtime version is used.const -
SparkOptionsResponse.fromMap(Map<
String, dynamic> map) -
factory
Properties
-
archiveUris
→ Input<
List< String> > -
Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
-
connection
→ Input<
String> -
Fully qualified name of the user-provided Spark connection object. Format:
"projects/{project_id}/locations/{location_id}/connections/{connection_id}"final -
containerImage
→ Input<
String> -
Custom container image for the runtime environment.
final
-
fileUris
→ Input<
List< String> > -
Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
final
- hashCode → int
-
The hash code for this object.
no setterinherited
-
jarUris
→ Input<
List< String> > -
JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
final
-
mainClass
→ Input<
String> -
The fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type.
final
-
mainFileUri
→ Input<
String> -
The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.
final
-
properties
→ Input<
Map< String, String> > -
Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list.
final
-
pyFileUris
→ Input<
List< String> > -
Python files to be placed on the PYTHONPATH for PySpark application. Supported file types:
.py,.egg, and.zip. For more information about Apache Spark, see Apache Spark.final - runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
-
runtimeVersion
→ Input<
String> -
Runtime version. If not specified, the default runtime version is used.
final
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toMap(
) → Map< String, dynamic> -
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited