glue-2017-03-31 library

Classes

Action
Defines an action to be initiated by a trigger.
AwsClientCredentials
AWS credentials.
BackfillError
A list of errors that can occur when registering partition indexes for an existing table.
BatchCreatePartitionResponse
BatchDeleteConnectionResponse
BatchDeletePartitionResponse
BatchDeleteTableResponse
BatchDeleteTableVersionResponse
BatchGetCrawlersResponse
BatchGetDevEndpointsResponse
BatchGetJobsResponse
BatchGetPartitionResponse
BatchGetTriggersResponse
BatchGetWorkflowsResponse
BatchStopJobRunError
Records an error that occurred when attempting to stop a specified job run.
BatchStopJobRunResponse
BatchStopJobRunSuccessfulSubmission
Records a successful request to stop a specified JobRun.
BatchUpdatePartitionFailureEntry
Contains information about a batch update partition error.
BatchUpdatePartitionRequestEntry
A structure that contains the values and structure used to update a partition.
BatchUpdatePartitionResponse
BinaryColumnStatisticsData
Defines column statistics supported for bit sequence data values.
BooleanColumnStatisticsData
Defines column statistics supported for Boolean data columns.
CancelMLTaskRunResponse
CatalogEntry
Specifies a table definition in the AWS Glue Data Catalog.
CatalogImportStatus
A structure containing migration status information.
CatalogTarget
Specifies an AWS Glue Data Catalog target.
CheckSchemaVersionValidityResponse
Classifier
Classifiers are triggered during a crawl task. A classifier checks whether a given file is in a format it can handle. If it is, the classifier creates a schema in the form of a StructType object that matches that data format.
CloudWatchEncryption
Specifies how Amazon CloudWatch data should be encrypted.
CodeGenEdge
Represents a directional edge in a directed acyclic graph (DAG).
CodeGenNode
Represents a node in a directed acyclic graph (DAG)
CodeGenNodeArg
An argument or property of a node.
Column
A column in a Table.
ColumnError
Encapsulates a column name that failed and the reason for failure.
ColumnImportance
A structure containing the column name and column importance score for a column.
ColumnStatistics
Represents the generated column-level statistics for a table or partition.
ColumnStatisticsData
Contains the individual types of column statistics data. Only one data object should be set and indicated by the Type attribute.
ColumnStatisticsError
Encapsulates a ColumnStatistics object that failed and the reason for failure.
Condition
Defines a condition under which a trigger fires.
ConfusionMatrix
The confusion matrix shows you what your transform is predicting accurately and what types of errors it is making.
Connection
Defines a connection to a data source.
ConnectionInput
A structure that is used to specify a connection to create or update.
ConnectionPasswordEncryption
The data structure used by the Data Catalog to encrypt the password as part of CreateConnection or UpdateConnection and store it in the ENCRYPTED_PASSWORD field in the connection properties. You can enable catalog encryption or only password encryption.
ConnectionsList
Specifies the connections used by a job.
Crawl
The details of a crawl in the workflow.
Crawler
Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the AWS Glue Data Catalog.
CrawlerMetrics
Metrics for a specified crawler.
CrawlerNodeDetails
The details of a Crawler node present in the workflow.
CrawlerTargets
Specifies data stores to crawl.
CreateClassifierResponse
CreateConnectionResponse
CreateCrawlerResponse
CreateCsvClassifierRequest
Specifies a custom CSV classifier for CreateClassifier to create.
CreateDatabaseResponse
CreateDevEndpointResponse
CreateGrokClassifierRequest
Specifies a grok classifier for CreateClassifier to create.
CreateJobResponse
CreateJsonClassifierRequest
Specifies a JSON classifier for CreateClassifier to create.
CreateMLTransformResponse
CreatePartitionIndexResponse
CreatePartitionResponse
CreateRegistryResponse
CreateSchemaResponse
CreateScriptResponse
CreateSecurityConfigurationResponse
CreateTableResponse
CreateTriggerResponse
CreateUserDefinedFunctionResponse
CreateWorkflowResponse
CreateXMLClassifierRequest
Specifies an XML classifier for CreateClassifier to create.
CsvClassifier
A classifier for custom CSV content.
Database
The Database object represents a logical grouping of tables that might reside in a Hive metastore or an RDBMS.
DatabaseIdentifier
A structure that describes a target database for resource linking.
DatabaseInput
The structure used to create or update a database.
DataCatalogEncryptionSettings
Contains configuration information for maintaining Data Catalog security.
DataLakePrincipal
The AWS Lake Formation principal.
DateColumnStatisticsData
Defines column statistics supported for timestamp data columns.
DecimalColumnStatisticsData
Defines column statistics supported for fixed-point number data columns.
DecimalNumber
Contains a numeric value in decimal format.
DeleteClassifierResponse
DeleteColumnStatisticsForPartitionResponse
DeleteColumnStatisticsForTableResponse
DeleteConnectionResponse
DeleteCrawlerResponse
DeleteDatabaseResponse
DeleteDevEndpointResponse
DeleteJobResponse
DeleteMLTransformResponse
DeletePartitionIndexResponse
DeletePartitionResponse
DeleteRegistryResponse
DeleteResourcePolicyResponse
DeleteSchemaResponse
DeleteSchemaVersionsResponse
DeleteSecurityConfigurationResponse
DeleteTableResponse
DeleteTableVersionResponse
DeleteTriggerResponse
DeleteUserDefinedFunctionResponse
DeleteWorkflowResponse
DevEndpoint
A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.
DevEndpointCustomLibraries
Custom libraries to be loaded into a development endpoint.
DoubleColumnStatisticsData
Defines column statistics supported for floating-point number data columns.
DynamoDBTarget
Specifies an Amazon DynamoDB table to crawl.
Edge
An edge represents a directed connection between two AWS Glue components that are part of the workflow the edge belongs to.
EncryptionAtRest
Specifies the encryption-at-rest configuration for the Data Catalog.
EncryptionConfiguration
Specifies an encryption configuration.
ErrorDetail
Contains details about an error.
ErrorDetails
An object containing error details.
EvaluationMetrics
Evaluation metrics provide an estimate of the quality of your machine learning transform.
ExecutionProperty
An execution property of a job.
ExportLabelsTaskRunProperties
Specifies configuration properties for an exporting labels task run.
FindMatchesMetrics
The evaluation metrics for the find matches algorithm. The quality of your machine learning transform is measured by getting your transform to predict some matches and comparing the results to known matches from the same dataset. The quality metrics are based on a subset of your data, so they are not precise.
FindMatchesParameters
The parameters to configure the find matches transform.
FindMatchesTaskRunProperties
Specifies configuration properties for a Find Matches task run.
GetCatalogImportStatusResponse
GetClassifierResponse
GetClassifiersResponse
GetColumnStatisticsForPartitionResponse
GetColumnStatisticsForTableResponse
GetConnectionResponse
GetConnectionsFilter
Filters the connection definitions that are returned by the GetConnections API operation.
GetConnectionsResponse
GetCrawlerMetricsResponse
GetCrawlerResponse
GetCrawlersResponse
GetDatabaseResponse
GetDatabasesResponse
GetDataCatalogEncryptionSettingsResponse
GetDataflowGraphResponse
GetDevEndpointResponse
GetDevEndpointsResponse
GetJobBookmarkResponse
GetJobResponse
GetJobRunResponse
GetJobRunsResponse
GetJobsResponse
GetMappingResponse
GetMLTaskRunResponse
GetMLTaskRunsResponse
GetMLTransformResponse
GetMLTransformsResponse
GetPartitionIndexesResponse
GetPartitionResponse
GetPartitionsResponse
GetPlanResponse
GetRegistryResponse
GetResourcePoliciesResponse
GetResourcePolicyResponse
GetSchemaByDefinitionResponse
GetSchemaResponse
GetSchemaVersionResponse
GetSchemaVersionsDiffResponse
GetSecurityConfigurationResponse
GetSecurityConfigurationsResponse
GetTableResponse
GetTablesResponse
GetTableVersionResponse
GetTableVersionsResponse
GetTagsResponse
GetTriggerResponse
GetTriggersResponse
GetUserDefinedFunctionResponse
GetUserDefinedFunctionsResponse
GetWorkflowResponse
GetWorkflowRunPropertiesResponse
GetWorkflowRunResponse
GetWorkflowRunsResponse
Glue
Defines the public endpoint for the AWS Glue service.
GluePolicy
A structure for returning a resource policy.
GlueTable
The database and table in the AWS Glue Data Catalog that is used for input or output data.
GrokClassifier
A classifier that uses grok patterns.
ImportCatalogToGlueResponse
ImportLabelsTaskRunProperties
Specifies configuration properties for an importing labels task run.
JdbcTarget
Specifies a JDBC data store to crawl.
Job
Specifies a job definition.
JobBookmarkEntry
Defines a point that a job can resume processing.
JobBookmarksEncryption
Specifies how job bookmark data should be encrypted.
JobCommand
Specifies code executed when a job is run.
JobNodeDetails
The details of a Job node present in the workflow.
JobRun
Contains information about a job run.
JobUpdate
Specifies information used to update an existing job definition. The previous job definition is completely overwritten by this information.
JsonClassifier
A classifier for JSON content.
KeySchemaElement
A partition key pair consisting of a name and a type.
LabelingSetGenerationTaskRunProperties
Specifies configuration properties for a labeling set generation task run.
LastCrawlInfo
Status and error information about the most recent crawl.
LineageConfiguration
Specifies data lineage configuration settings for the crawler.
ListCrawlersResponse
ListDevEndpointsResponse
ListJobsResponse
ListMLTransformsResponse
ListRegistriesResponse
ListSchemasResponse
ListSchemaVersionsResponse
ListTriggersResponse
ListWorkflowsResponse
Location
The location of resources.
LongColumnStatisticsData
Defines column statistics supported for integer data columns.
MappingEntry
Defines a mapping.
MetadataInfo
A structure containing metadata information for a schema version.
MetadataKeyValuePair
A structure containing a key value pair for metadata.
MLTransform
A structure for a machine learning transform.
MLUserDataEncryption
The encryption-at-rest settings of the transform that apply to accessing user data.
MongoDBTarget
Specifies an Amazon DocumentDB or MongoDB data store to crawl.
Node
A node represents an AWS Glue component such as a trigger, or job, etc., that is part of a workflow.
NotificationProperty
Specifies configuration properties of a notification.
Order
Specifies the sort order of a sorted column.
Partition
Represents a slice of table data.
PartitionError
Contains information about a partition error.
PartitionIndex
A structure for a partition index.
PartitionIndexDescriptor
A descriptor for a partition index in a table.
PartitionInput
The structure used to create and update a partition.
PartitionValueList
Contains a list of values defining partitions.
PhysicalConnectionRequirements
Specifies the physical requirements for a connection.
Predecessor
A job run that was used in the predicate of a conditional trigger that triggered this job run.
Predicate
Defines the predicate of the trigger, which determines when it fires.
PrincipalPermissions
Permissions granted to a principal.
PropertyPredicate
Defines a property predicate.
PutDataCatalogEncryptionSettingsResponse
PutResourcePolicyResponse
PutSchemaVersionMetadataResponse
PutWorkflowRunPropertiesResponse
QuerySchemaVersionMetadataResponse
RecrawlPolicy
When crawling an Amazon S3 data source after the first crawl is complete, specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run. For more information, see Incremental Crawls in AWS Glue in the developer guide.
RegisterSchemaVersionResponse
RegistryId
A wrapper structure that may contain the registry name and Amazon Resource Name (ARN).
RegistryListItem
A structure containing the details for a registry.
RemoveSchemaVersionMetadataResponse
ResetJobBookmarkResponse
ResourceUri
The URIs for function resources.
ResumeWorkflowRunResponse
S3Encryption
Specifies how Amazon Simple Storage Service (Amazon S3) data should be encrypted.
S3Target
Specifies a data store in Amazon Simple Storage Service (Amazon S3).
Schedule
A scheduling object using a cron statement to schedule an event.
SchemaChangePolicy
A policy that specifies update and deletion behaviors for the crawler.
SchemaColumn
A key-value pair representing a column and data type that this transform can run against. The Schema parameter of the MLTransform may contain up to 100 of these structures.
SchemaId
The unique ID of the schema in the AWS Glue schema registry.
SchemaListItem
An object that contains minimal details for a schema.
SchemaReference
An object that references a schema stored in the AWS Glue Schema Registry.
SchemaVersionErrorItem
An object that contains the error details for an operation on a schema version.
SchemaVersionListItem
An object containing the details about a schema version.
SchemaVersionNumber
A structure containing the schema version information.
SearchTablesResponse
SecurityConfiguration
Specifies a security configuration.
Segment
Defines a non-overlapping region of a table's partitions, allowing multiple requests to be executed in parallel.
SerDeInfo
Information about a serialization/deserialization program (SerDe) that serves as an extractor and loader.
SkewedInfo
Specifies skewed values in a table. Skewed values are those that occur with very high frequency.
SortCriterion
Specifies a field to sort by and a sort order.
StartCrawlerResponse
StartCrawlerScheduleResponse
StartExportLabelsTaskRunResponse
StartImportLabelsTaskRunResponse
StartJobRunResponse
StartMLEvaluationTaskRunResponse
StartMLLabelingSetGenerationTaskRunResponse
StartTriggerResponse
StartWorkflowRunResponse
StopCrawlerResponse
StopCrawlerScheduleResponse
StopTriggerResponse
StopWorkflowRunResponse
StorageDescriptor
Describes the physical storage of table data.
StringColumnStatisticsData
Defines column statistics supported for character sequence data values.
Table
Represents a collection of related data organized in columns and rows.
TableError
An error record for table operations.
TableIdentifier
A structure that describes a target table for resource linking.
TableInput
A structure used to define a table.
TableVersion
Specifies a version of a table.
TableVersionError
An error record for table-version operations.
TagResourceResponse
TaskRun
The sampling parameters that are associated with the machine learning transform.
TaskRunFilterCriteria
The criteria that are used to filter the task runs for the machine learning transform.
TaskRunProperties
The configuration properties for the task run.
TaskRunSortCriteria
The sorting criteria that are used to sort the list of task runs for the machine learning transform.
TransformEncryption
The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.
TransformFilterCriteria
The criteria used to filter the machine learning transforms.
TransformParameters
The algorithm-specific parameters that are associated with the machine learning transform.
TransformSortCriteria
The sorting criteria that are associated with the machine learning transform.
Trigger
Information about a specific trigger.
TriggerNodeDetails
The details of a Trigger node present in the workflow.
TriggerUpdate
A structure used to provide information used to update a trigger. This object updates the previous trigger definition by overwriting it completely.
UntagResourceResponse
UpdateClassifierResponse
UpdateColumnStatisticsForPartitionResponse
UpdateColumnStatisticsForTableResponse
UpdateConnectionResponse
UpdateCrawlerResponse
UpdateCrawlerScheduleResponse
UpdateCsvClassifierRequest
Specifies a custom CSV classifier to be updated.
UpdateDatabaseResponse
UpdateDevEndpointResponse
UpdateGrokClassifierRequest
Specifies a grok classifier to update when passed to UpdateClassifier.
UpdateJobResponse
UpdateJsonClassifierRequest
Specifies a JSON classifier to be updated.
UpdateMLTransformResponse
UpdatePartitionResponse
UpdateRegistryResponse
UpdateSchemaResponse
UpdateTableResponse
UpdateTriggerResponse
UpdateUserDefinedFunctionResponse
UpdateWorkflowResponse
UpdateXMLClassifierRequest
Specifies an XML classifier to be updated.
UserDefinedFunction
Represents the equivalent of a Hive user-defined function (UDF) definition.
UserDefinedFunctionInput
A structure used to create or update a user-defined function.
Workflow
A workflow represents a flow in which AWS Glue components should be executed to complete a logical task.
WorkflowGraph
A workflow graph represents the complete workflow containing all the AWS Glue components present in the workflow and all the directed connections between them.
WorkflowRun
A workflow run is an execution of a workflow providing all the runtime information.
WorkflowRunStatistics
Workflow run statistics provides statistics about the workflow run.
XMLClassifier
A classifier for XML content.

Extensions

BackfillErrorCodeFromString on String
BackfillErrorCodeValueExtension on BackfillErrorCode
CatalogEncryptionModeFromString on String
CatalogEncryptionModeValueExtension on CatalogEncryptionMode
CloudWatchEncryptionModeFromString on String
CloudWatchEncryptionModeValueExtension on CloudWatchEncryptionMode
ColumnStatisticsTypeFromString on String
ColumnStatisticsTypeValueExtension on ColumnStatisticsType
ComparatorFromString on String
ComparatorValueExtension on Comparator
CompatibilityFromString on String
CompatibilityValueExtension on Compatibility
ConnectionPropertyKeyFromString on String
ConnectionPropertyKeyValueExtension on ConnectionPropertyKey
ConnectionTypeFromString on String
ConnectionTypeValueExtension on ConnectionType
CrawlerLineageSettingsFromString on String
CrawlerLineageSettingsValueExtension on CrawlerLineageSettings
CrawlerStateFromString on String
CrawlerStateValueExtension on CrawlerState
CrawlStateFromString on String
CrawlStateValueExtension on CrawlState
CsvHeaderOptionFromString on String
CsvHeaderOptionValueExtension on CsvHeaderOption
DataFormatFromString on String
DataFormatValueExtension on DataFormat
DeleteBehaviorFromString on String
DeleteBehaviorValueExtension on DeleteBehavior
EnableHybridValuesFromString on String
EnableHybridValuesValueExtension on EnableHybridValues
ExistConditionFromString on String
ExistConditionValueExtension on ExistCondition
JobBookmarksEncryptionModeFromString on String
JobBookmarksEncryptionModeValueExtension on JobBookmarksEncryptionMode
JobRunStateFromString on String
JobRunStateValueExtension on JobRunState
LanguageFromString on String
LanguageValueExtension on Language
LastCrawlStatusFromString on String
LastCrawlStatusValueExtension on LastCrawlStatus
LogicalFromString on String
LogicalOperatorFromString on String
LogicalOperatorValueExtension on LogicalOperator
LogicalValueExtension on Logical
MLUserDataEncryptionModeStringFromString on String
MLUserDataEncryptionModeStringValueExtension on MLUserDataEncryptionModeString
NodeTypeFromString on String
NodeTypeValueExtension on NodeType
PartitionIndexStatusFromString on String
PartitionIndexStatusValueExtension on PartitionIndexStatus
PermissionFromString on String
PermissionValueExtension on Permission
PrincipalTypeFromString on String
PrincipalTypeValueExtension on PrincipalType
RecrawlBehaviorFromString on String
RecrawlBehaviorValueExtension on RecrawlBehavior
RegistryStatusFromString on String
RegistryStatusValueExtension on RegistryStatus
ResourceShareTypeFromString on String
ResourceShareTypeValueExtension on ResourceShareType
ResourceTypeFromString on String
ResourceTypeValueExtension on ResourceType
S3EncryptionModeFromString on String
S3EncryptionModeValueExtension on S3EncryptionMode
ScheduleStateFromString on String
ScheduleStateValueExtension on ScheduleState
SchemaDiffTypeFromString on String
SchemaDiffTypeValueExtension on SchemaDiffType
SchemaStatusFromString on String
SchemaStatusValueExtension on SchemaStatus
SchemaVersionStatusFromString on String
SchemaVersionStatusValueExtension on SchemaVersionStatus
SortDirectionTypeFromString on String
SortDirectionTypeValueExtension on SortDirectionType
SortFromString on String
SortValueExtension on Sort
TaskRunSortColumnTypeFromString on String
TaskRunSortColumnTypeValueExtension on TaskRunSortColumnType
TaskStatusTypeFromString on String
TaskStatusTypeValueExtension on TaskStatusType
TaskTypeFromString on String
TaskTypeValueExtension on TaskType
TransformSortColumnTypeFromString on String
TransformSortColumnTypeValueExtension on TransformSortColumnType
TransformStatusTypeFromString on String
TransformStatusTypeValueExtension on TransformStatusType
TransformTypeFromString on String
TransformTypeValueExtension on TransformType
TriggerStateFromString on String
TriggerStateValueExtension on TriggerState
TriggerTypeFromString on String
TriggerTypeValueExtension on TriggerType
UpdateBehaviorFromString on String
UpdateBehaviorValueExtension on UpdateBehavior
WorkerTypeFromString on String
WorkerTypeValueExtension on WorkerType
WorkflowRunStatusFromString on String
WorkflowRunStatusValueExtension on WorkflowRunStatus