elasticmapreduce-2009-03-31
library
Classes
-
AddInstanceFleetOutput
-
-
AddInstanceGroupsOutput
-
Output from an AddInstanceGroups call.
-
AddJobFlowStepsOutput
-
The output for the AddJobFlowSteps operation.
-
AddTagsOutput
-
This output indicates the result of adding tags to a resource.
-
Application
-
With Amazon EMR release version 4.0 and later, the only accepted parameter
is the application name. To pass arguments to applications, you use
configuration classifications specified using configuration JSON objects.
For more information, see Configuring
Applications.
-
AutoScalingPolicy
-
An automatic scaling policy for a core instance group or task instance group
in an Amazon EMR cluster. An automatic scaling policy defines how an
instance group dynamically adds and terminates EC2 instances in response to
the value of a CloudWatch metric. See PutAutoScalingPolicy.
-
AutoScalingPolicyDescription
-
An automatic scaling policy for a core instance group or task instance group
in an Amazon EMR cluster. The automatic scaling policy defines how an
instance group dynamically adds and terminates EC2 instances in response to
the value of a CloudWatch metric. See PutAutoScalingPolicy.
-
AutoScalingPolicyStateChangeReason
-
The reason for an AutoScalingPolicyStatus change.
-
AutoScalingPolicyStatus
-
The status of an automatic scaling policy.
-
AwsClientCredentials
-
AWS credentials.
-
BlockPublicAccessConfiguration
-
A configuration for Amazon EMR block public access. When
BlockPublicSecurityGroupRules
is set to true
,
Amazon EMR prevents cluster creation if one of the cluster's security groups
has a rule that allows inbound traffic from 0.0.0.0/0 or ::/0 on a port,
unless the port is specified as an exception using
PermittedPublicSecurityGroupRuleRanges
.
-
BlockPublicAccessConfigurationMetadata
-
Properties that describe the AWS principal that created the
BlockPublicAccessConfiguration
using the
PutBlockPublicAccessConfiguration
action as well as the date
and time that the configuration was created. Each time a configuration for
block public access is updated, Amazon EMR updates this metadata.
-
BootstrapActionConfig
-
Configuration of a bootstrap action.
-
BootstrapActionDetail
-
Reports the configuration of a bootstrap action in a cluster (job flow).
-
CancelStepsInfo
-
Specification of the status of a CancelSteps request. Available only in
Amazon EMR version 4.8.0 and later, excluding version 5.0.0.
-
CancelStepsOutput
-
The output for the CancelSteps operation.
-
CloudWatchAlarmDefinition
-
The definition of a CloudWatch metric alarm, which determines when an
automatic scaling activity is triggered. When the defined alarm conditions
are satisfied, scaling activity begins.
-
Cluster
-
The detailed description of the cluster.
-
ClusterStateChangeReason
-
The reason that the cluster changed to its current state.
-
ClusterStatus
-
The detailed status of the cluster.
-
ClusterSummary
-
The summary description of the cluster.
-
ClusterTimeline
-
Represents the timeline of the cluster's lifecycle.
-
Command
-
An entity describing an executable that runs on a cluster.
-
ComputeLimits
-
The EC2 unit limits for a managed scaling policy. The managed scaling
activity of a cluster can not be above or below these limits. The limit only
applies to the core and task nodes. The master node cannot be scaled after
initial configuration.
-
Configuration
-
Configuring
Applications
-
CreateSecurityConfigurationOutput
-
-
CreateStudioOutput
-
-
DeleteSecurityConfigurationOutput
-
-
DescribeClusterOutput
-
This output contains the description of the cluster.
-
DescribeJobFlowsOutput
-
The output for the DescribeJobFlows operation.
-
DescribeNotebookExecutionOutput
-
-
DescribeSecurityConfigurationOutput
-
-
DescribeStepOutput
-
This output contains the description of the cluster step.
-
DescribeStudioOutput
-
-
EbsBlockDevice
-
Configuration of requested EBS block device associated with the instance
group.
-
EbsBlockDeviceConfig
-
Configuration of requested EBS block device associated with the instance
group with count of volumes that will be associated to every instance.
-
EbsConfiguration
-
The Amazon EBS configuration of a cluster instance.
-
EbsVolume
-
EBS block device that's attached to an EC2 instance.
-
Ec2InstanceAttributes
-
Provides information about the EC2 instances in a cluster grouped by
category. For example, key name, subnet ID, IAM instance profile, and so on.
-
EMR
-
Amazon EMR is a web service that makes it easier to process large amounts of
data efficiently. Amazon EMR uses Hadoop processing combined with several
AWS services to do tasks such as web indexing, data mining, log file
analysis, machine learning, scientific simulation, and data warehouse
management.
-
ExecutionEngineConfig
-
Specifies the execution engine (cluster) to run the notebook and perform the
notebook execution, for example, an EMR cluster.
-
FailureDetails
-
The details of the step failure. The service attempts to detect the root
cause for many common failures.
-
GetBlockPublicAccessConfigurationOutput
-
-
GetManagedScalingPolicyOutput
-
-
GetStudioSessionMappingOutput
-
-
HadoopJarStepConfig
-
A job flow step consisting of a JAR file whose main function will be
executed. The main function submits a job for Hadoop to execute and waits
for the job to finish or fail.
-
HadoopStepConfig
-
A cluster step consisting of a JAR file whose main function will be
executed. The main function submits a job for Hadoop to execute and waits
for the job to finish or fail.
-
Instance
-
Represents an EC2 instance provisioned as part of cluster.
-
InstanceFleet
-
Describes an instance fleet, which is a group of EC2 instances that host a
particular node type (master, core, or task) in an Amazon EMR cluster.
Instance fleets can consist of a mix of instance types and On-Demand and
Spot Instances, which are provisioned to meet a defined target capacity.
-
InstanceFleetConfig
-
The configuration that defines an instance fleet.
-
InstanceFleetModifyConfig
-
Configuration parameters for an instance fleet modification request.
-
InstanceFleetProvisioningSpecifications
-
The launch specification for Spot Instances in the fleet, which determines
the defined duration, provisioning timeout behavior, and allocation
strategy.
-
InstanceFleetStateChangeReason
-
Provides status change reason details for the instance fleet.
-
InstanceFleetStatus
-
The status of the instance fleet.
-
InstanceFleetTimeline
-
Provides historical timestamps for the instance fleet, including the time of
creation, the time it became ready to run jobs, and the time of termination.
-
InstanceGroup
-
This entity represents an instance group, which is a group of instances that
have common purpose. For example, CORE instance group is used for HDFS.
-
InstanceGroupConfig
-
Configuration defining a new instance group.
-
InstanceGroupDetail
-
Detailed information about an instance group.
-
InstanceGroupModifyConfig
-
Modify the size or configurations of an instance group.
-
InstanceGroupStateChangeReason
-
The status change reason details for the instance group.
-
InstanceGroupStatus
-
The details of the instance group status.
-
InstanceGroupTimeline
-
The timeline of the instance group lifecycle.
-
InstanceResizePolicy
-
Custom policy for requesting termination protection or termination of
specific instances when shrinking an instance group.
-
InstanceStateChangeReason
-
The details of the status change reason for the instance.
-
InstanceStatus
-
The instance status details.
-
InstanceTimeline
-
The timeline of the instance lifecycle.
-
InstanceTypeConfig
-
An instance type configuration for each instance type in an instance fleet,
which determines the EC2 instances Amazon EMR attempts to provision to
fulfill On-Demand and Spot target capacities. There can be a maximum of five
instance type configurations in a fleet.
-
InstanceTypeSpecification
-
The configuration specification for each instance type in an instance fleet.
-
JobFlowDetail
-
A description of a cluster (job flow).
-
JobFlowExecutionStatusDetail
-
Describes the status of the cluster (job flow).
-
JobFlowInstancesConfig
-
A description of the Amazon EC2 instance on which the cluster (job flow)
runs. A valid JobFlowInstancesConfig must contain either InstanceGroups or
InstanceFleets. They cannot be used together. You may also have
MasterInstanceType, SlaveInstanceType, and InstanceCount (all three must be
present), but we don't recommend this configuration.
-
JobFlowInstancesDetail
-
Specify the type of Amazon EC2 instances that the cluster (job flow) runs
on.
-
KerberosAttributes
-
Attributes for Kerberos configuration when Kerberos authentication is
enabled using a security configuration. For more information see Use
Kerberos Authentication in the Amazon EMR Management Guide.
-
KeyValue
-
A key-value pair.
-
ListBootstrapActionsOutput
-
This output contains the bootstrap actions detail.
-
ListClustersOutput
-
This contains a ClusterSummaryList with the cluster details; for example,
the cluster IDs, names, and status.
-
ListInstanceFleetsOutput
-
-
ListInstanceGroupsOutput
-
This input determines which instance groups to retrieve.
-
ListInstancesOutput
-
This output contains the list of instances.
-
ListNotebookExecutionsOutput
-
-
ListSecurityConfigurationsOutput
-
-
ListStepsOutput
-
This output contains the list of steps returned in reverse order. This means
that the last step is the first element in the list.
-
ListStudioSessionMappingsOutput
-
-
ListStudiosOutput
-
-
ManagedScalingPolicy
-
Managed scaling policy for an Amazon EMR cluster. The policy specifies the
limits for resources that can be added or terminated from a cluster. The
policy only applies to the core and task nodes. The master node cannot be
scaled after initial configuration.
-
MetricDimension
-
A CloudWatch dimension, which is specified using a
Key
(known
as a Name
in CloudWatch), Value
pair. By default,
Amazon EMR uses one dimension whose Key
is
JobFlowID
and Value
is a variable representing the
cluster ID, which is ${emr.clusterId}
. This enables the rule to
bootstrap when the cluster ID becomes available.
-
ModifyClusterOutput
-
-
NotebookExecution
-
A notebook execution. An execution is a specific instance that an EMR
Notebook is run using the
StartNotebookExecution
action.
-
NotebookExecutionSummary
-
-
OnDemandProvisioningSpecification
-
The launch specification for On-Demand Instances in the instance fleet,
which determines the allocation strategy.
-
PlacementGroupConfig
-
Placement group configuration for an Amazon EMR cluster. The configuration
specifies the placement strategy that can be applied to instance roles
during cluster creation.
-
PlacementType
-
The Amazon EC2 Availability Zone configuration of the cluster (job flow).
-
PortRange
-
A list of port ranges that are permitted to allow inbound traffic from all
public IP addresses. To specify a single port, use the same value for
MinRange
and MaxRange
.
-
PutAutoScalingPolicyOutput
-
-
PutBlockPublicAccessConfigurationOutput
-
-
PutManagedScalingPolicyOutput
-
-
RemoveAutoScalingPolicyOutput
-
-
RemoveManagedScalingPolicyOutput
-
-
RemoveTagsOutput
-
This output indicates the result of removing tags from a resource.
-
RunJobFlowOutput
-
The result of the RunJobFlow operation.
-
ScalingAction
-
The type of adjustment the automatic scaling activity makes when triggered,
and the periodicity of the adjustment.
-
ScalingConstraints
-
The upper and lower EC2 instance limits for an automatic scaling policy.
Automatic scaling activities triggered by automatic scaling rules will not
cause an instance group to grow above or below these limits.
-
ScalingRule
-
A scale-in or scale-out rule that defines scaling activity, including the
CloudWatch metric alarm that triggers activity, how EC2 instances are added
or removed, and the periodicity of adjustments. The automatic scaling policy
for an instance group can comprise one or more automatic scaling rules.
-
ScalingTrigger
-
The conditions that trigger an automatic scaling activity.
-
ScriptBootstrapActionConfig
-
Configuration of the script to run during a bootstrap action.
-
SecurityConfigurationSummary
-
The creation date and time, and name, of a security configuration.
-
SessionMappingDetail
-
Details for an Amazon EMR Studio session mapping including creation time,
user or group ID, Studio ID, and so on.
-
SessionMappingSummary
-
Details for an Amazon EMR Studio session mapping. The details do not include
the time the session mapping was last modified.
-
ShrinkPolicy
-
Policy for customizing shrink operations. Allows configuration of
decommissioning timeout and targeted instance shrinking.
-
SimpleScalingPolicyConfiguration
-
An automatic scaling configuration, which describes how the policy adds or
removes instances, the cooldown period, and the number of EC2 instances that
will be added each time the CloudWatch metric alarm condition is satisfied.
-
SpotProvisioningSpecification
-
The launch specification for Spot Instances in the instance fleet, which
determines the defined duration, provisioning timeout behavior, and
allocation strategy.
-
StartNotebookExecutionOutput
-
-
Step
-
This represents a step in a cluster.
-
StepConfig
-
Specification of a cluster (job flow) step.
-
StepDetail
-
Combines the execution state and configuration of a step.
-
StepExecutionStatusDetail
-
The execution state of a step.
-
StepStateChangeReason
-
The details of the step state change reason.
-
StepStatus
-
The execution status details of the cluster step.
-
StepSummary
-
The summary of the cluster step.
-
StepTimeline
-
The timeline of the cluster step lifecycle.
-
Studio
-
Details for an Amazon EMR Studio including ID, creation time, name, and so
on.
-
StudioSummary
-
Details for an Amazon EMR Studio, including ID, Name, VPC, and Description.
The details do not include subnets, IAM roles, security groups, or tags
associated with the Studio.
-
SupportedProductConfig
-
The list of supported product configurations which allow user-supplied
arguments. EMR accepts these arguments and forwards them to the
corresponding installation script as bootstrap action arguments.
-
Tag
-
A key-value pair containing user-defined metadata that you can associate
with an Amazon EMR resource. Tags make it easier to associate clusters in
various ways, such as grouping clusters to track your Amazon EMR resource
allocation costs. For more information, see Tag
Clusters.
-
VolumeSpecification
-
EBS volume specifications such as volume type, IOPS, and size (GiB) that
will be requested for the EBS volume attached to an EC2 instance in the
cluster.