JobSparkConfig class

Constructors

JobSparkConfig({Input<List<String>?>? archiveUris, Input<List<String>?>? args, Input<List<String>?>? fileUris, Input<List<String>?>? jarFileUris, Input<JobSparkConfigLoggingConfig?>? loggingConfig, Input<String?>? mainClass, Input<String?>? mainJarFileUri, Input<Map<String, String>?>? properties})

Creates a new JobSparkConfig. archiveUris HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip. args The arguments to pass to the driver. fileUris HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks. jarFileUris HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks. loggingConfig The runtime logging config of the job mainClass The class containing the main method of the driver. Must be in a mainJarFileUri The HCFS URI of jar file containing properties A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

const

JobSparkConfig.fromMap(Map<String, dynamic> map)

factory

Properties

archiveUris → Input<List<String>?>?

HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.

final

args → Input<List<String>?>?

The arguments to pass to the driver.

final

fileUris → Input<List<String>?>?

HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks. Useful for naively parallel tasks.

final

hashCode → int

The hash code for this object.

no setter, inherited

jarFileUris → Input<List<String>?>?

HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.

final

loggingConfig → Input<JobSparkConfigLoggingConfig?>?

The runtime logging config of the job

final

mainClass → Input<String?>?

The class containing the main method of the driver. Must be in a provided jar or jar that is already on the classpath. Conflicts with mainJarFileUri

final

mainJarFileUri → Input<String?>?

The HCFS URI of jar file containing the driver jar. Conflicts with mainClass

final

properties → Input<Map<String, String>?>?

A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

final

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toMap() → Map<String, dynamic>

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited