JobHadoopConfig class

Constructors

JobHadoopConfig({Input<List<String>?>? archiveUris, Input<List<String>?>? args, Input<List<String>?>? fileUris, Input<List<String>?>? jarFileUris, Input<JobHadoopConfigLoggingConfig?>? loggingConfig, Input<String?>? mainClass, Input<String?>? mainJarFileUri, Input<Map<String, String>?>? properties})

Creates a new JobHadoopConfig. archiveUris HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip. args The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission. fileUris HCFS URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks. jarFileUris HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks. loggingConfig The runtime logging config of the job mainClass The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jarFileUris. Conflicts with mainJarFileUri mainJarFileUri The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'. Conflicts with mainClass properties A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code..

const

JobHadoopConfig.fromMap(Map<String, dynamic> map)

factory

Properties

archiveUris → Input<List<String>?>?

HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.

final

args → Input<List<String>?>?

The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

final

fileUris → Input<List<String>?>?

HCFS URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.

final

hashCode → int

The hash code for this object.

no setter, inherited

jarFileUris → Input<List<String>?>?

HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.

final

loggingConfig → Input<JobHadoopConfigLoggingConfig?>?

The runtime logging config of the job

final

mainClass → Input<String?>?

The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jarFileUris. Conflicts with mainJarFileUri

final

mainJarFileUri → Input<String?>?

The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'. Conflicts with mainClass

final

properties → Input<Map<String, String>?>?

A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code..

final

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toMap() → Map<String, dynamic>

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited