RoutineSparkOptions constructor
- Input<
List< ? archiveUris,String> ?> - Input<
String?> ? connection, - Input<
String?> ? containerImage, - Input<
List< ? fileUris,String> ?> - Input<
List< ? jarUris,String> ?> - Input<
String?> ? mainClass, - Input<
String?> ? mainFileUri, - Input<
Map< ? properties,String, String> ?> - Input<
List< ? pyFileUris,String> ?> - Input<
String?> ? runtimeVersion,
Creates a new RoutineSparkOptions.
archiveUris Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
connection Fully qualified name of the user-provided Spark connection object.
containerImage Custom container image for the runtime environment.
fileUris Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
jarUris JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
mainClass The fully qualified name of a class in jarUris, for example, com.example.wordcount.
mainFileUri The main file/jar URI of the Spark application.
properties Configuration properties as a set of key/value pairs, which will be passed on to the Spark application.
pyFileUris Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.
runtimeVersion Runtime version. If not specified, the default runtime version is used.
Implementation
const RoutineSparkOptions({
this.archiveUris,
this.connection,
this.containerImage,
this.fileUris,
this.jarUris,
this.mainClass,
this.mainFileUri,
this.properties,
this.pyFileUris,
this.runtimeVersion,
});