events/cloud/dataplex/v1
library
Classes
-
Asset
-
An asset represents a cloud resource that is being managed within a lake as a
member of a zone.
-
Asset_DiscoverySpec
-
Settings to manage the metadata discovery and publishing for an asset.
-
Asset_DiscoverySpec_CsvOptions
-
Describe CSV and similar semi-structured data formats.
-
Asset_DiscoverySpec_JsonOptions
-
Describe JSON data format.
-
Asset_DiscoveryStatus
-
Status of discovery for an asset.
-
Asset_DiscoveryStatus_State
-
Current state of discovery.
-
Asset_DiscoveryStatus_Stats
-
The aggregated data statistics for the asset reported by discovery.
-
Asset_ResourceSpec
-
Identifies the cloud resource that is referenced by this asset.
-
Asset_ResourceSpec_AccessMode
-
Access Mode determines how data stored within the resource is read. This
is only applicable to storage bucket assets.
-
Asset_ResourceSpec_Type
-
Type of resource.
-
Asset_ResourceStatus
-
Status of the resource referenced by an asset.
-
Asset_ResourceStatus_State
-
The state of a resource.
-
Asset_SecurityStatus
-
Security policy status of the asset. Data security policy, i.e., readers,
writers & owners, should be specified in the lake/zone/asset IAM policy.
-
Asset_SecurityStatus_State
-
The state of the security policy.
-
AssetCreatedEvent
-
The CloudEvent raised when an Asset is created.
-
AssetDeletedEvent
-
The CloudEvent raised when an Asset is deleted.
-
AssetEventData
-
The data within all Asset events.
-
AssetStatus
-
Aggregated status of the underlying assets of a lake or zone.
-
AssetUpdatedEvent
-
The CloudEvent raised when an Asset is updated.
-
DataAccessSpec
-
DataAccessSpec holds the access control configuration to be enforced on data
stored within resources (eg: rows, columns in BigQuery Tables). When
associated with data, the data is only accessible to
principals explicitly granted access through the DataAccessSpec. Principals
with access to the containing resource are not implicitly granted access.
-
DataAttribute
-
Denotes one dataAttribute in a dataTaxonomy, for example, PII.
DataAttribute resources can be defined in a hierarchy.
A single dataAttribute resource can contain specs of multiple types
-
DataAttributeBinding
-
DataAttributeBinding represents binding of attributes to resources. Eg: Bind
'CustomerInfo' entity with 'PII' attribute.
-
DataAttributeBinding_Path
-
Represents a subresource of a given resource, and associated bindings with
it.
-
DataAttributeBindingCreatedEvent
-
The CloudEvent raised when a DataAttributeBinding is created.
-
DataAttributeBindingDeletedEvent
-
The CloudEvent raised when a DataAttributeBinding is deleted.
-
DataAttributeBindingEventData
-
The data within all DataAttributeBinding events.
-
DataAttributeBindingUpdatedEvent
-
The CloudEvent raised when a DataAttributeBinding is updated.
-
DataAttributeCreatedEvent
-
The CloudEvent raised when a DataAttribute is created.
-
DataAttributeDeletedEvent
-
The CloudEvent raised when a DataAttribute is deleted.
-
DataAttributeEventData
-
The data within all DataAttribute events.
-
DataAttributeUpdatedEvent
-
The CloudEvent raised when a DataAttribute is updated.
-
DataProfileResult
-
DataProfileResult defines the output of DataProfileScan. Each field of the
table will have field type specific profile result.
-
DataProfileResult_Profile
-
Contains name, type, mode and field type specific profile information.
-
DataProfileResult_Profile_Field
-
A field within a table.
-
DataProfileResult_Profile_Field_ProfileInfo
-
The profile information for each field type.
-
DataProfileResult_Profile_Field_ProfileInfo_DoubleFieldInfo
-
The profile information for a double type field.
-
DataProfileResult_Profile_Field_ProfileInfo_IntegerFieldInfo
-
The profile information for an integer type field.
-
DataProfileResult_Profile_Field_ProfileInfo_StringFieldInfo
-
The profile information for a string type field.
-
DataProfileResult_Profile_Field_ProfileInfo_TopNValue
-
Top N non-null values in the scanned data.
-
DataProfileSpec
-
DataProfileScan related setting.
-
DataQualityDimensionResult
-
DataQualityDimensionResult provides a more detailed, per-dimension view of
the results.
-
DataQualityResult
-
The output of a DataQualityScan.
-
DataQualityRule
-
A rule captures data quality intent about a data source.
-
DataQualityRule_NonNullExpectation
-
Evaluates whether each column value is null.
-
DataQualityRule_RangeExpectation
-
Evaluates whether each column value lies between a specified range.
-
DataQualityRule_RegexExpectation
-
Evaluates whether each column value matches a specified regex.
-
DataQualityRule_RowConditionExpectation
-
Evaluates whether each row passes the specified condition.
-
DataQualityRule_SetExpectation
-
Evaluates whether each column value is contained by a specified set.
-
DataQualityRule_StatisticRangeExpectation
-
Evaluates whether the column aggregate statistic lies between a specified
range.
-
DataQualityRule_StatisticRangeExpectation_ColumnStatistic
-
-
DataQualityRule_TableConditionExpectation
-
Evaluates whether the provided expression is true.
-
DataQualityRule_UniquenessExpectation
-
Evaluates whether the column has duplicates.
-
DataQualityRuleResult
-
DataQualityRuleResult provides a more detailed, per-rule view of the results.
-
DataQualitySpec
-
DataQualityScan related setting.
-
DataScan
-
Represents a user-visible job which provides the insights for the related
data source.
-
DataScan_ExecutionSpec
-
DataScan execution settings.
-
DataScan_ExecutionStatus
-
Status of the data scan execution.
-
DataScanCreatedEvent
-
The CloudEvent raised when a DataScan is created.
-
DataScanDeletedEvent
-
The CloudEvent raised when a DataScan is deleted.
-
DataScanEventData
-
The data within all DataScan events.
-
DataScanType
-
The type of DataScan.
-
DataScanUpdatedEvent
-
The CloudEvent raised when a DataScan is updated.
-
DataSource
-
The data source for DataScan.
-
DataTaxonomy
-
DataTaxonomy represents a set of hierarchical DataAttributes resources,
grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes
to manage PII data. It is defined at project level.
-
DataTaxonomyCreatedEvent
-
The CloudEvent raised when a DataTaxonomy is created.
-
DataTaxonomyDeletedEvent
-
The CloudEvent raised when a DataTaxonomy is deleted.
-
DataTaxonomyEventData
-
The data within all DataTaxonomy events.
-
DataTaxonomyUpdatedEvent
-
The CloudEvent raised when a DataTaxonomy is updated.
-
Environment
-
Environment represents a user-visible compute infrastructure for analytics
within a lake.
-
Environment_Endpoints
-
URI Endpoints to access sessions associated with the Environment.
-
Environment_InfrastructureSpec
-
Configuration for the underlying infrastructure used to run workloads.
-
Environment_InfrastructureSpec_ComputeResources
-
Compute resources associated with the analyze interactive workloads.
-
Environment_InfrastructureSpec_OsImageRuntime
-
Software Runtime Configuration to run Analyze.
-
Environment_SessionSpec
-
Configuration for sessions created for this environment.
-
Environment_SessionStatus
-
Status of sessions created for this environment.
-
EnvironmentCreatedEvent
-
The CloudEvent raised when an Environment is created.
-
EnvironmentDeletedEvent
-
The CloudEvent raised when an Environment is deleted.
-
EnvironmentEventData
-
The data within all Environment events.
-
EnvironmentUpdatedEvent
-
The CloudEvent raised when an Environment is updated.
-
Job
-
A job represents an instance of a task.
-
Job_Service
-
-
Job_State
-
-
Lake
-
A lake is a centralized repository for managing enterprise data across the
organization distributed across many cloud projects, and stored in a variety
of storage services such as Google Cloud Storage and BigQuery. The resources
attached to a lake are referred to as managed resources. Data within these
managed resources can be structured or unstructured. A lake provides data
admins with tools to organize, secure and manage their data at scale, and
provides data scientists and data engineers an integrated experience to
easily search, discover, analyze and transform data and associated metadata.
-
Lake_Metastore
-
Settings to manage association of Dataproc Metastore with a lake.
-
Lake_MetastoreStatus
-
Status of Lake and Dataproc Metastore service instance association.
-
Lake_MetastoreStatus_State
-
Current state of association.
-
LakeCreatedEvent
-
The CloudEvent raised when a Lake is created.
-
LakeDeletedEvent
-
The CloudEvent raised when a Lake is deleted.
-
LakeEventData
-
The data within all Lake events.
-
LakeUpdatedEvent
-
The CloudEvent raised when a Lake is updated.
-
ResourceAccessSpec
-
ResourceAccessSpec holds the access control configuration to be enforced
on the resources, for example, Cloud Storage bucket, BigQuery dataset,
BigQuery table.
-
ScannedData
-
The data scanned during processing (e.g. in incremental DataScan)
-
ScannedData_IncrementalField
-
A data range denoted by a pair of start/end values of a field.
-
State
-
State of a resource.
-
Task
-
A task represents a user-visible job.
-
Task_ExecutionSpec
-
Execution related settings, like retry and service_account.
-
Task_ExecutionStatus
-
Status of the task execution (e.g. Jobs).
-
Task_InfrastructureSpec
-
Configuration for the underlying infrastructure used to run workloads.
-
Task_InfrastructureSpec_BatchComputeResources
-
Batch compute resources associated with the task.
-
Task_InfrastructureSpec_ContainerImageRuntime
-
Container Image Runtime Configuration used with Batch execution.
-
Task_InfrastructureSpec_VpcNetwork
-
Cloud VPC Network used to run the infrastructure.
-
Task_NotebookTaskConfig
-
Config for running scheduled notebooks.
-
Task_SparkTaskConfig
-
User-specified config for running a Spark task.
-
Task_TriggerSpec
-
Task scheduling and trigger settings.
-
Task_TriggerSpec_Type
-
Determines how often and when the job will run.
-
TaskCreatedEvent
-
The CloudEvent raised when a Task is created.
-
TaskDeletedEvent
-
The CloudEvent raised when a Task is deleted.
-
TaskEventData
-
The data within all Task events.
-
TaskUpdatedEvent
-
The CloudEvent raised when a Task is updated.
-
Trigger
-
DataScan scheduling and trigger settings.
-
Trigger_OnDemand
-
The scan runs once via
RunDataScan
API.
-
Trigger_Schedule
-
The scan is scheduled to run periodically.
-
Zone
-
A zone represents a logical group of related assets within a lake. A zone can
be used to map to organizational structure or represent stages of data
readiness from raw to curated. It provides managing behavior that is shared
or inherited by all contained assets.
-
Zone_DiscoverySpec
-
Settings to manage the metadata discovery and publishing in a zone.
-
Zone_DiscoverySpec_CsvOptions
-
Describe CSV and similar semi-structured data formats.
-
Zone_DiscoverySpec_JsonOptions
-
Describe JSON data format.
-
Zone_ResourceSpec
-
Settings for resources attached as assets within a zone.
-
Zone_ResourceSpec_LocationType
-
Location type of the resources attached to a zone.
-
Zone_Type
-
Type of zone.
-
ZoneCreatedEvent
-
The CloudEvent raised when a Zone is created.
-
ZoneDeletedEvent
-
The CloudEvent raised when a Zone is deleted.
-
ZoneEventData
-
The data within all Zone events.
-
ZoneUpdatedEvent
-
The CloudEvent raised when a Zone is updated.