tests.system.google.cloud.dataplex.example_dataplex_dp

示例 Airflow DAG,展示如何使用 Dataplex 数据扫描。

属性

ENV_ID

PROJECT_ID

DAG_ID

LAKE_ID

REGION

DATASET

TABLE_1

TABLE_2

SCHEMA

INSERT_DATE

INSERT_ROWS_QUERY

LOCATION

TRIGGER_SPEC_TYPE

ZONE_ID

DATA_SCAN_ID

EXAMPLE_LAKE_BODY

EXAMPLE_ZONE

ASSET_ID

EXAMPLE_ASSET

EXAMPLE_DATA_SCAN

UPDATE_MASK

ENTITY

EXAMPLE_DATA_SCAN_UPDATE

create_dataset

test_run

模块内容

tests.system.google.cloud.dataplex.example_dataplex_dp.ENV_ID[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.PROJECT_ID[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.DAG_ID = 'dataplex_data_profile'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.LAKE_ID = ''[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.REGION = 'us-central1'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.DATASET = 'dataset_bq_dataplex_data_profile_Uninferable'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.TABLE_1 = 'table0'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.TABLE_2 = 'table1'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.SCHEMA[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.INSERT_DATE[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.INSERT_ROWS_QUERY = "INSERT dataset_bq_dataplex_data_profile_Uninferable.table0 VALUES (1, 'test test2', 'Uninferable');"[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.LOCATION = 'us'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.TRIGGER_SPEC_TYPE = 'ON_DEMAND'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.ZONE_ID = ''[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.DATA_SCAN_ID = ''[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.EXAMPLE_LAKE_BODY[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.EXAMPLE_ZONE[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.ASSET_ID = ''[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.EXAMPLE_ASSET[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.EXAMPLE_DATA_SCAN[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.UPDATE_MASK[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.ENTITY = 'projects/Uninferable/locations/us-central1/lakes//zones//entities/table0'[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.EXAMPLE_DATA_SCAN_UPDATE[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.create_dataset[源码]
tests.system.google.cloud.dataplex.example_dataplex_dp.test_run[源码]

此条目有帮助吗?