glue-2017-03-31
library
Classes
Action
Defines an action to be initiated by a trigger.
AwsClientCredentials
AWS credentials.
BackfillError
A list of errors that can occur when registering partition indexes for an
existing table.
BatchCreatePartitionResponse
BatchDeleteConnectionResponse
BatchDeletePartitionResponse
BatchDeleteTableResponse
BatchDeleteTableVersionResponse
BatchGetCrawlersResponse
BatchGetDevEndpointsResponse
BatchGetJobsResponse
BatchGetPartitionResponse
BatchGetTriggersResponse
BatchGetWorkflowsResponse
BatchStopJobRunError
Records an error that occurred when attempting to stop a specified job run.
BatchStopJobRunResponse
BatchStopJobRunSuccessfulSubmission
Records a successful request to stop a specified JobRun
.
BatchUpdatePartitionFailureEntry
Contains information about a batch update partition error.
BatchUpdatePartitionRequestEntry
A structure that contains the values and structure used to update a
partition.
BatchUpdatePartitionResponse
BinaryColumnStatisticsData
Defines column statistics supported for bit sequence data values.
BooleanColumnStatisticsData
Defines column statistics supported for Boolean data columns.
CancelMLTaskRunResponse
CatalogEntry
Specifies a table definition in the AWS Glue Data Catalog.
CatalogImportStatus
A structure containing migration status information.
CatalogTarget
Specifies an AWS Glue Data Catalog target.
CheckSchemaVersionValidityResponse
Classifier
Classifiers are triggered during a crawl task. A classifier checks whether a
given file is in a format it can handle. If it is, the classifier creates a
schema in the form of a StructType
object that matches that
data format.
CloudWatchEncryption
Specifies how Amazon CloudWatch data should be encrypted.
CodeGenEdge
Represents a directional edge in a directed acyclic graph (DAG).
CodeGenNode
Represents a node in a directed acyclic graph (DAG)
CodeGenNodeArg
An argument or property of a node.
Column
A column in a Table
.
ColumnError
Encapsulates a column name that failed and the reason for failure.
ColumnImportance
A structure containing the column name and column importance score for a
column.
ColumnStatistics
Represents the generated column-level statistics for a table or partition.
ColumnStatisticsData
Contains the individual types of column statistics data. Only one data
object should be set and indicated by the Type
attribute.
ColumnStatisticsError
Encapsulates a ColumnStatistics
object that failed and the
reason for failure.
Condition
Defines a condition under which a trigger fires.
ConfusionMatrix
The confusion matrix shows you what your transform is predicting accurately
and what types of errors it is making.
Connection
Defines a connection to a data source.
ConnectionInput
A structure that is used to specify a connection to create or update.
ConnectionPasswordEncryption
The data structure used by the Data Catalog to encrypt the password as part
of CreateConnection
or UpdateConnection
and store
it in the ENCRYPTED_PASSWORD
field in the connection
properties. You can enable catalog encryption or only password encryption.
ConnectionsList
Specifies the connections used by a job.
Crawl
The details of a crawl in the workflow.
Crawler
Specifies a crawler program that examines a data source and uses classifiers
to try to determine its schema. If successful, the crawler records metadata
concerning the data source in the AWS Glue Data Catalog.
CrawlerMetrics
Metrics for a specified crawler.
CrawlerNodeDetails
The details of a Crawler node present in the workflow.
CrawlerTargets
Specifies data stores to crawl.
CreateClassifierResponse
CreateConnectionResponse
CreateCrawlerResponse
CreateCsvClassifierRequest
Specifies a custom CSV classifier for CreateClassifier
to
create.
CreateDatabaseResponse
CreateDevEndpointResponse
CreateGrokClassifierRequest
Specifies a grok
classifier for CreateClassifier
to create.
CreateJobResponse
CreateJsonClassifierRequest
Specifies a JSON classifier for CreateClassifier
to create.
CreateMLTransformResponse
CreatePartitionIndexResponse
CreatePartitionResponse
CreateRegistryResponse
CreateSchemaResponse
CreateScriptResponse
CreateSecurityConfigurationResponse
CreateTableResponse
CreateTriggerResponse
CreateUserDefinedFunctionResponse
CreateWorkflowResponse
CreateXMLClassifierRequest
Specifies an XML classifier for CreateClassifier
to create.
CsvClassifier
A classifier for custom CSV
content.
Database
The Database
object represents a logical grouping of tables
that might reside in a Hive metastore or an RDBMS.
DatabaseIdentifier
A structure that describes a target database for resource linking.
DatabaseInput
The structure used to create or update a database.
DataCatalogEncryptionSettings
Contains configuration information for maintaining Data Catalog security.
DataLakePrincipal
The AWS Lake Formation principal.
DateColumnStatisticsData
Defines column statistics supported for timestamp data columns.
DecimalColumnStatisticsData
Defines column statistics supported for fixed-point number data columns.
DecimalNumber
Contains a numeric value in decimal format.
DeleteClassifierResponse
DeleteColumnStatisticsForPartitionResponse
DeleteColumnStatisticsForTableResponse
DeleteConnectionResponse
DeleteCrawlerResponse
DeleteDatabaseResponse
DeleteDevEndpointResponse
DeleteJobResponse
DeleteMLTransformResponse
DeletePartitionIndexResponse
DeletePartitionResponse
DeleteRegistryResponse
DeleteResourcePolicyResponse
DeleteSchemaResponse
DeleteSchemaVersionsResponse
DeleteSecurityConfigurationResponse
DeleteTableResponse
DeleteTableVersionResponse
DeleteTriggerResponse
DeleteUserDefinedFunctionResponse
DeleteWorkflowResponse
DevEndpoint
A development endpoint where a developer can remotely debug extract,
transform, and load (ETL) scripts.
DevEndpointCustomLibraries
Custom libraries to be loaded into a development endpoint.
DoubleColumnStatisticsData
Defines column statistics supported for floating-point number data columns.
DynamoDBTarget
Specifies an Amazon DynamoDB table to crawl.
Edge
An edge represents a directed connection between two AWS Glue components
that are part of the workflow the edge belongs to.
EncryptionAtRest
Specifies the encryption-at-rest configuration for the Data Catalog.
EncryptionConfiguration
Specifies an encryption configuration.
ErrorDetail
Contains details about an error.
ErrorDetails
An object containing error details.
EvaluationMetrics
Evaluation metrics provide an estimate of the quality of your machine
learning transform.
ExecutionProperty
An execution property of a job.
ExportLabelsTaskRunProperties
Specifies configuration properties for an exporting labels task run.
FindMatchesMetrics
The evaluation metrics for the find matches algorithm. The quality of your
machine learning transform is measured by getting your transform to predict
some matches and comparing the results to known matches from the same
dataset. The quality metrics are based on a subset of your data, so they are
not precise.
FindMatchesParameters
The parameters to configure the find matches transform.
FindMatchesTaskRunProperties
Specifies configuration properties for a Find Matches task run.
GetCatalogImportStatusResponse
GetClassifierResponse
GetClassifiersResponse
GetColumnStatisticsForPartitionResponse
GetColumnStatisticsForTableResponse
GetConnectionResponse
GetConnectionsFilter
Filters the connection definitions that are returned by the
GetConnections
API operation.
GetConnectionsResponse
GetCrawlerMetricsResponse
GetCrawlerResponse
GetCrawlersResponse
GetDatabaseResponse
GetDatabasesResponse
GetDataCatalogEncryptionSettingsResponse
GetDataflowGraphResponse
GetDevEndpointResponse
GetDevEndpointsResponse
GetJobBookmarkResponse
GetJobResponse
GetJobRunResponse
GetJobRunsResponse
GetJobsResponse
GetMappingResponse
GetMLTaskRunResponse
GetMLTaskRunsResponse
GetMLTransformResponse
GetMLTransformsResponse
GetPartitionIndexesResponse
GetPartitionResponse
GetPartitionsResponse
GetPlanResponse
GetRegistryResponse
GetResourcePoliciesResponse
GetResourcePolicyResponse
GetSchemaByDefinitionResponse
GetSchemaResponse
GetSchemaVersionResponse
GetSchemaVersionsDiffResponse
GetSecurityConfigurationResponse
GetSecurityConfigurationsResponse
GetTableResponse
GetTablesResponse
GetTableVersionResponse
GetTableVersionsResponse
GetTagsResponse
GetTriggerResponse
GetTriggersResponse
GetUserDefinedFunctionResponse
GetUserDefinedFunctionsResponse
GetWorkflowResponse
GetWorkflowRunPropertiesResponse
GetWorkflowRunResponse
GetWorkflowRunsResponse
Glue
Defines the public endpoint for the AWS Glue service.
GluePolicy
A structure for returning a resource policy.
GlueTable
The database and table in the AWS Glue Data Catalog that is used for input
or output data.
GrokClassifier
A classifier that uses grok
patterns.
ImportCatalogToGlueResponse
ImportLabelsTaskRunProperties
Specifies configuration properties for an importing labels task run.
JdbcTarget
Specifies a JDBC data store to crawl.
Job
Specifies a job definition.
JobBookmarkEntry
Defines a point that a job can resume processing.
JobBookmarksEncryption
Specifies how job bookmark data should be encrypted.
JobCommand
Specifies code executed when a job is run.
JobNodeDetails
The details of a Job node present in the workflow.
JobRun
Contains information about a job run.
JobUpdate
Specifies information used to update an existing job definition. The
previous job definition is completely overwritten by this information.
JsonClassifier
A classifier for JSON
content.
KeySchemaElement
A partition key pair consisting of a name and a type.
LabelingSetGenerationTaskRunProperties
Specifies configuration properties for a labeling set generation task run.
LastCrawlInfo
Status and error information about the most recent crawl.
LineageConfiguration
Specifies data lineage configuration settings for the crawler.
ListCrawlersResponse
ListDevEndpointsResponse
ListJobsResponse
ListMLTransformsResponse
ListRegistriesResponse
ListSchemasResponse
ListSchemaVersionsResponse
ListTriggersResponse
ListWorkflowsResponse
Location
The location of resources.
LongColumnStatisticsData
Defines column statistics supported for integer data columns.
MappingEntry
Defines a mapping.
MetadataInfo
A structure containing metadata information for a schema version.
MetadataKeyValuePair
A structure containing a key value pair for metadata.
MLTransform
A structure for a machine learning transform.
MLUserDataEncryption
The encryption-at-rest settings of the transform that apply to accessing
user data.
MongoDBTarget
Specifies an Amazon DocumentDB or MongoDB data store to crawl.
Node
A node represents an AWS Glue component such as a trigger, or job, etc.,
that is part of a workflow.
NotificationProperty
Specifies configuration properties of a notification.
Order
Specifies the sort order of a sorted column.
Partition
Represents a slice of table data.
PartitionError
Contains information about a partition error.
PartitionIndex
A structure for a partition index.
PartitionIndexDescriptor
A descriptor for a partition index in a table.
PartitionInput
The structure used to create and update a partition.
PartitionValueList
Contains a list of values defining partitions.
PhysicalConnectionRequirements
Specifies the physical requirements for a connection.
Predecessor
A job run that was used in the predicate of a conditional trigger that
triggered this job run.
Predicate
Defines the predicate of the trigger, which determines when it fires.
PrincipalPermissions
Permissions granted to a principal.
PropertyPredicate
Defines a property predicate.
PutDataCatalogEncryptionSettingsResponse
PutResourcePolicyResponse
PutSchemaVersionMetadataResponse
PutWorkflowRunPropertiesResponse
QuerySchemaVersionMetadataResponse
RecrawlPolicy
When crawling an Amazon S3 data source after the first crawl is complete,
specifies whether to crawl the entire dataset again or to crawl only folders
that were added since the last crawler run. For more information, see Incremental
Crawls in AWS Glue in the developer guide.
RegisterSchemaVersionResponse
RegistryId
A wrapper structure that may contain the registry name and Amazon Resource
Name (ARN).
RegistryListItem
A structure containing the details for a registry.
RemoveSchemaVersionMetadataResponse
ResetJobBookmarkResponse
ResourceUri
The URIs for function resources.
ResumeWorkflowRunResponse
S3Encryption
Specifies how Amazon Simple Storage Service (Amazon S3) data should be
encrypted.
S3Target
Specifies a data store in Amazon Simple Storage Service (Amazon S3).
Schedule
A scheduling object using a cron
statement to schedule an
event.
SchemaChangePolicy
A policy that specifies update and deletion behaviors for the crawler.
SchemaColumn
A key-value pair representing a column and data type that this transform can
run against. The Schema
parameter of the
MLTransform
may contain up to 100 of these structures.
SchemaId
The unique ID of the schema in the AWS Glue schema registry.
SchemaListItem
An object that contains minimal details for a schema.
SchemaReference
An object that references a schema stored in the AWS Glue Schema Registry.
SchemaVersionErrorItem
An object that contains the error details for an operation on a schema
version.
SchemaVersionListItem
An object containing the details about a schema version.
SchemaVersionNumber
A structure containing the schema version information.
SearchTablesResponse
SecurityConfiguration
Specifies a security configuration.
Segment
Defines a non-overlapping region of a table's partitions, allowing multiple
requests to be executed in parallel.
SerDeInfo
Information about a serialization/deserialization program (SerDe) that
serves as an extractor and loader.
SkewedInfo
Specifies skewed values in a table. Skewed values are those that occur with
very high frequency.
SortCriterion
Specifies a field to sort by and a sort order.
StartCrawlerResponse
StartCrawlerScheduleResponse
StartExportLabelsTaskRunResponse
StartImportLabelsTaskRunResponse
StartJobRunResponse
StartMLEvaluationTaskRunResponse
StartMLLabelingSetGenerationTaskRunResponse
StartTriggerResponse
StartWorkflowRunResponse
StopCrawlerResponse
StopCrawlerScheduleResponse
StopTriggerResponse
StopWorkflowRunResponse
StorageDescriptor
Describes the physical storage of table data.
StringColumnStatisticsData
Defines column statistics supported for character sequence data values.
Table
Represents a collection of related data organized in columns and rows.
TableError
An error record for table operations.
TableIdentifier
A structure that describes a target table for resource linking.
TableInput
A structure used to define a table.
TableVersion
Specifies a version of a table.
TableVersionError
An error record for table-version operations.
TagResourceResponse
TaskRun
The sampling parameters that are associated with the machine learning
transform.
TaskRunFilterCriteria
The criteria that are used to filter the task runs for the machine learning
transform.
TaskRunProperties
The configuration properties for the task run.
TaskRunSortCriteria
The sorting criteria that are used to sort the list of task runs for the
machine learning transform.
TransformEncryption
The encryption-at-rest settings of the transform that apply to accessing
user data. Machine learning transforms can access user data encrypted in
Amazon S3 using KMS.
TransformFilterCriteria
The criteria used to filter the machine learning transforms.
TransformParameters
The algorithm-specific parameters that are associated with the machine
learning transform.
TransformSortCriteria
The sorting criteria that are associated with the machine learning
transform.
Trigger
Information about a specific trigger.
TriggerNodeDetails
The details of a Trigger node present in the workflow.
TriggerUpdate
A structure used to provide information used to update a trigger. This
object updates the previous trigger definition by overwriting it completely.
UntagResourceResponse
UpdateClassifierResponse
UpdateColumnStatisticsForPartitionResponse
UpdateColumnStatisticsForTableResponse
UpdateConnectionResponse
UpdateCrawlerResponse
UpdateCrawlerScheduleResponse
UpdateCsvClassifierRequest
Specifies a custom CSV classifier to be updated.
UpdateDatabaseResponse
UpdateDevEndpointResponse
UpdateGrokClassifierRequest
Specifies a grok classifier to update when passed to
UpdateClassifier
.
UpdateJobResponse
UpdateJsonClassifierRequest
Specifies a JSON classifier to be updated.
UpdateMLTransformResponse
UpdatePartitionResponse
UpdateRegistryResponse
UpdateSchemaResponse
UpdateTableResponse
UpdateTriggerResponse
UpdateUserDefinedFunctionResponse
UpdateWorkflowResponse
UpdateXMLClassifierRequest
Specifies an XML classifier to be updated.
UserDefinedFunction
Represents the equivalent of a Hive user-defined function (UDF
)
definition.
UserDefinedFunctionInput
A structure used to create or update a user-defined function.
Workflow
A workflow represents a flow in which AWS Glue components should be executed
to complete a logical task.
WorkflowGraph
A workflow graph represents the complete workflow containing all the AWS
Glue components present in the workflow and all the directed connections
between them.
WorkflowRun
A workflow run is an execution of a workflow providing all the runtime
information.
WorkflowRunStatistics
Workflow run statistics provides statistics about the workflow run.
XMLClassifier
A classifier for XML
content.