TaskSpark class

Constructors

TaskSpark({Input<List<String>?>? archiveUris, Input<List<String>?>? fileUris, Input<TaskSparkInfrastructureSpec?>? infrastructureSpec, Input<String?>? mainClass, Input<String?>? mainJarFileUri, Input<String?>? pythonScriptFile, Input<String?>? sqlScript, Input<String?>? sqlScriptFile})

Creates a new TaskSpark. archiveUris Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip. fileUris Cloud Storage URIs of files to be placed in the working directory of each executor. infrastructureSpec Infrastructure specification for the execution. mainClass The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value). mainJarFileUri The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value). pythonScriptFile The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value). sqlScript The query text. The execution args are used to declare a set of script variables (set key='value';). sqlScriptFile A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key='value';).

const

TaskSpark.fromMap(Map<String, dynamic> map)

factory

Properties

archiveUris → Input<List<String>?>?

Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

final

fileUris → Input<List<String>?>?

Cloud Storage URIs of files to be placed in the working directory of each executor.

final

hashCode → int

The hash code for this object.

no setter, inherited

infrastructureSpec → Input<TaskSparkInfrastructureSpec?>?

Infrastructure specification for the execution. Structure is documented below.

final

mainClass → Input<String?>?

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

final

mainJarFileUri → Input<String?>?

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

final

pythonScriptFile → Input<String?>?

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

final

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

sqlScript → Input<String?>?

The query text. The execution args are used to declare a set of script variables (set key='value';).

final

sqlScriptFile → Input<String?>?

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key='value';).

final

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toMap() → Map<String, dynamic>

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited