events/cloud/dataplex/v1 library

Classes

Asset
An asset represents a cloud resource that is being managed within a lake as a member of a zone.
Asset_DiscoverySpec
Settings to manage the metadata discovery and publishing for an asset.
Asset_DiscoverySpec_CsvOptions
Describe CSV and similar semi-structured data formats.
Asset_DiscoverySpec_JsonOptions
Describe JSON data format.
Asset_DiscoveryStatus
Status of discovery for an asset.
Asset_DiscoveryStatus_State
Current state of discovery.
Asset_DiscoveryStatus_Stats
The aggregated data statistics for the asset reported by discovery.
Asset_ResourceSpec
Identifies the cloud resource that is referenced by this asset.
Asset_ResourceSpec_AccessMode
Access Mode determines how data stored within the resource is read. This is only applicable to storage bucket assets.
Asset_ResourceSpec_Type
Type of resource.
Asset_ResourceStatus
Status of the resource referenced by an asset.
Asset_ResourceStatus_State
The state of a resource.
Asset_SecurityStatus
Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.
Asset_SecurityStatus_State
The state of the security policy.
AssetCreatedEvent
The CloudEvent raised when an Asset is created.
AssetDeletedEvent
The CloudEvent raised when an Asset is deleted.
AssetEventData
The data within all Asset events.
AssetStatus
Aggregated status of the underlying assets of a lake or zone.
AssetUpdatedEvent
The CloudEvent raised when an Asset is updated.
DataAccessSpec
DataAccessSpec holds the access control configuration to be enforced on data stored within resources (eg: rows, columns in BigQuery Tables). When associated with data, the data is only accessible to principals explicitly granted access through the DataAccessSpec. Principals with access to the containing resource are not implicitly granted access.
DataAttribute
Denotes one dataAttribute in a dataTaxonomy, for example, PII. DataAttribute resources can be defined in a hierarchy. A single dataAttribute resource can contain specs of multiple types
DataAttributeBinding
DataAttributeBinding represents binding of attributes to resources. Eg: Bind 'CustomerInfo' entity with 'PII' attribute.
DataAttributeBinding_Path
Represents a subresource of a given resource, and associated bindings with it.
DataAttributeBindingCreatedEvent
The CloudEvent raised when a DataAttributeBinding is created.
DataAttributeBindingDeletedEvent
The CloudEvent raised when a DataAttributeBinding is deleted.
DataAttributeBindingEventData
The data within all DataAttributeBinding events.
DataAttributeBindingUpdatedEvent
The CloudEvent raised when a DataAttributeBinding is updated.
DataAttributeCreatedEvent
The CloudEvent raised when a DataAttribute is created.
DataAttributeDeletedEvent
The CloudEvent raised when a DataAttribute is deleted.
DataAttributeEventData
The data within all DataAttribute events.
DataAttributeUpdatedEvent
The CloudEvent raised when a DataAttribute is updated.
DataProfileResult
DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.
DataProfileResult_Profile
Contains name, type, mode and field type specific profile information.
DataProfileResult_Profile_Field
A field within a table.
DataProfileResult_Profile_Field_ProfileInfo
The profile information for each field type.
DataProfileResult_Profile_Field_ProfileInfo_DoubleFieldInfo
The profile information for a double type field.
DataProfileResult_Profile_Field_ProfileInfo_IntegerFieldInfo
The profile information for an integer type field.
DataProfileResult_Profile_Field_ProfileInfo_StringFieldInfo
The profile information for a string type field.
DataProfileResult_Profile_Field_ProfileInfo_TopNValue
Top N non-null values in the scanned data.
DataProfileSpec
DataProfileScan related setting.
DataQualityDimensionResult
DataQualityDimensionResult provides a more detailed, per-dimension view of the results.
DataQualityResult
The output of a DataQualityScan.
DataQualityRule
A rule captures data quality intent about a data source.
DataQualityRule_NonNullExpectation
Evaluates whether each column value is null.
DataQualityRule_RangeExpectation
Evaluates whether each column value lies between a specified range.
DataQualityRule_RegexExpectation
Evaluates whether each column value matches a specified regex.
DataQualityRule_RowConditionExpectation
Evaluates whether each row passes the specified condition.
DataQualityRule_SetExpectation
Evaluates whether each column value is contained by a specified set.
DataQualityRule_StatisticRangeExpectation
Evaluates whether the column aggregate statistic lies between a specified range.
DataQualityRule_StatisticRangeExpectation_ColumnStatistic
DataQualityRule_TableConditionExpectation
Evaluates whether the provided expression is true.
DataQualityRule_UniquenessExpectation
Evaluates whether the column has duplicates.
DataQualityRuleResult
DataQualityRuleResult provides a more detailed, per-rule view of the results.
DataQualitySpec
DataQualityScan related setting.
DataScan
Represents a user-visible job which provides the insights for the related data source.
DataScan_ExecutionSpec
DataScan execution settings.
DataScan_ExecutionStatus
Status of the data scan execution.
DataScanCreatedEvent
The CloudEvent raised when a DataScan is created.
DataScanDeletedEvent
The CloudEvent raised when a DataScan is deleted.
DataScanEventData
The data within all DataScan events.
DataScanType
The type of DataScan.
DataScanUpdatedEvent
The CloudEvent raised when a DataScan is updated.
DataSource
The data source for DataScan.
DataTaxonomy
DataTaxonomy represents a set of hierarchical DataAttributes resources, grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes to manage PII data. It is defined at project level.
DataTaxonomyCreatedEvent
The CloudEvent raised when a DataTaxonomy is created.
DataTaxonomyDeletedEvent
The CloudEvent raised when a DataTaxonomy is deleted.
DataTaxonomyEventData
The data within all DataTaxonomy events.
DataTaxonomyUpdatedEvent
The CloudEvent raised when a DataTaxonomy is updated.
Environment
Environment represents a user-visible compute infrastructure for analytics within a lake.
Environment_Endpoints
URI Endpoints to access sessions associated with the Environment.
Environment_InfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
Environment_InfrastructureSpec_ComputeResources
Compute resources associated with the analyze interactive workloads.
Environment_InfrastructureSpec_OsImageRuntime
Software Runtime Configuration to run Analyze.
Environment_SessionSpec
Configuration for sessions created for this environment.
Environment_SessionStatus
Status of sessions created for this environment.
EnvironmentCreatedEvent
The CloudEvent raised when an Environment is created.
EnvironmentDeletedEvent
The CloudEvent raised when an Environment is deleted.
EnvironmentEventData
The data within all Environment events.
EnvironmentUpdatedEvent
The CloudEvent raised when an Environment is updated.
Job
A job represents an instance of a task.
Job_Service
Job_State
Lake
A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.
Lake_Metastore
Settings to manage association of Dataproc Metastore with a lake.
Lake_MetastoreStatus
Status of Lake and Dataproc Metastore service instance association.
Lake_MetastoreStatus_State
Current state of association.
LakeCreatedEvent
The CloudEvent raised when a Lake is created.
LakeDeletedEvent
The CloudEvent raised when a Lake is deleted.
LakeEventData
The data within all Lake events.
LakeUpdatedEvent
The CloudEvent raised when a Lake is updated.
ResourceAccessSpec
ResourceAccessSpec holds the access control configuration to be enforced on the resources, for example, Cloud Storage bucket, BigQuery dataset, BigQuery table.
ScannedData
The data scanned during processing (e.g. in incremental DataScan)
ScannedData_IncrementalField
A data range denoted by a pair of start/end values of a field.
State
State of a resource.
Task
A task represents a user-visible job.
Task_ExecutionSpec
Execution related settings, like retry and service_account.
Task_ExecutionStatus
Status of the task execution (e.g. Jobs).
Task_InfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
Task_InfrastructureSpec_BatchComputeResources
Batch compute resources associated with the task.
Task_InfrastructureSpec_ContainerImageRuntime
Container Image Runtime Configuration used with Batch execution.
Task_InfrastructureSpec_VpcNetwork
Cloud VPC Network used to run the infrastructure.
Task_NotebookTaskConfig
Config for running scheduled notebooks.
Task_SparkTaskConfig
User-specified config for running a Spark task.
Task_TriggerSpec
Task scheduling and trigger settings.
Task_TriggerSpec_Type
Determines how often and when the job will run.
TaskCreatedEvent
The CloudEvent raised when a Task is created.
TaskDeletedEvent
The CloudEvent raised when a Task is deleted.
TaskEventData
The data within all Task events.
TaskUpdatedEvent
The CloudEvent raised when a Task is updated.
Trigger
DataScan scheduling and trigger settings.
Trigger_OnDemand
The scan runs once via RunDataScan API.
Trigger_Schedule
The scan is scheduled to run periodically.
Zone
A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.
Zone_DiscoverySpec
Settings to manage the metadata discovery and publishing in a zone.
Zone_DiscoverySpec_CsvOptions
Describe CSV and similar semi-structured data formats.
Zone_DiscoverySpec_JsonOptions
Describe JSON data format.
Zone_ResourceSpec
Settings for resources attached as assets within a zone.
Zone_ResourceSpec_LocationType
Location type of the resources attached to a zone.
Zone_Type
Type of zone.
ZoneCreatedEvent
The CloudEvent raised when a Zone is created.
ZoneDeletedEvent
The CloudEvent raised when a Zone is deleted.
ZoneEventData
The data within all Zone events.
ZoneUpdatedEvent
The CloudEvent raised when a Zone is updated.