tests.system.google.cloud.bigtable.example_bigtable¶

此 Airflow DAG 示例创建并执行 Cloud Bigtable 上的以下操作： - 创建一个实例 - 创建一个表 - 更新集群 - 等待表复制完成 - 删除表 - 删除实例

此 DAG 依赖于以下环境变量

GCP_PROJECT_ID - Google Cloud 项目
CBT_INSTANCE_ID - Cloud Bigtable 实例的期望 ID
CBT_INSTANCE_DISPLAY_NAME - 实例的期望的可读显示名称
CBT_INSTANCE_TYPE - 实例类型，例如 1 表示 DEVELOPMENT
参见 https://googleapis.github.io/google-cloud-python/latest/bigtable/instance.html#google.cloud.bigtable.instance.Instance
CBT_INSTANCE_LABELS - 要为实例添加的标签
CBT_CLUSTER_ID - 为实例创建的主集群的期望 ID
CBT_CLUSTER_ZONE - 创建主集群的区域，例如 europe-west1-b
参见可用区域: https://cloud.google.com/bigtable/docs/locations
CBT_CLUSTER_NODES - 集群的初始节点数量
CBT_CLUSTER_NODES_UPDATED - BigtableClusterUpdateOperator 的节点数量
CBT_CLUSTER_STORAGE_TYPE - 集群存储类型，例如 1 表示 SSD
参见 https://googleapis.github.io/google-cloud-python/latest/bigtable/instance.html#google.cloud.bigtable.instance.Instance.cluster
CBT_TABLE_ID - 表的期望 ID
CBT_POKE_INTERVAL - 传感器每次检查之间的秒数

模块内容¶

tests.system.google.cloud.bigtable.example_bigtable.DAG_ID = 'bigtable'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_ID_BASE = ''[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_ID_1 = '-1'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_ID_2 = '-2'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_DISPLAY_NAME = 'instance-name'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_DISPLAY_NAME_UPDATED = 'instance-name-updated'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_TYPE[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_TYPE_PROD[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_LABELS: dict[str, str][source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_INSTANCE_LABELS_UPDATED[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_CLUSTER_ID = 'bigtable-cluster-id'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_CLUSTER_ZONE = 'europe-west1-b'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_CLUSTER_NODES = 3[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_CLUSTER_NODES_UPDATED = 5[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_CLUSTER_STORAGE_TYPE[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_TABLE_ID = 'bigtable-table-id'[source]¶

tests.system.google.cloud.bigtable.example_bigtable.CBT_POKE_INTERVAL = 60[source]¶

tests.system.google.cloud.bigtable.example_bigtable.create_instance_task[source]¶

`ENV_ID`
`PROJECT_ID`
`DAG_ID`
`CBT_INSTANCE_ID_BASE`
`CBT_INSTANCE_ID_1`
`CBT_INSTANCE_ID_2`
`CBT_INSTANCE_DISPLAY_NAME`
`CBT_INSTANCE_DISPLAY_NAME_UPDATED`
`CBT_INSTANCE_TYPE`
`CBT_INSTANCE_TYPE_PROD`
`CBT_INSTANCE_LABELS`
`CBT_INSTANCE_LABELS_UPDATED`
`CBT_CLUSTER_ID`
`CBT_CLUSTER_ZONE`
`CBT_CLUSTER_NODES`
`CBT_CLUSTER_NODES_UPDATED`
`CBT_CLUSTER_STORAGE_TYPE`
`CBT_TABLE_ID`
`CBT_POKE_INTERVAL`
`create_instance_task`
`test_run`