tests.system.google.cloud.dataflow.example_dataflow_yaml¶

Google Cloud Dataflow YAML 服务的 Airflow DAG 示例。

要求: 此测试要求在 Airflow worker 上安装 gcloud 命令 (Google Cloud SDK) <https://cloud.google.com/sdk/docs/install>`__

属性¶

`PROJECT_ID`
`ENV_ID`
`DAG_ID`
`REGION`
`DATAFLOW_YAML_JOB_NAME`
`BQ_DATASET`
`BQ_INPUT_TABLE`
`BQ_OUTPUT_TABLE`
`DATAFLOW_YAML_PIPELINE_FILE_URL`
`SCHEMA`
`BQ_VARIABLES`
`BQ_VARIABLES_DEF`
`INSERT_ROWS_QUERY`
`create_bq_dataset`
`test_run`

tests.system.google.cloud.dataflow.example_dataflow_yaml.DAG_ID = 'dataflow_yaml'[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.REGION = 'europe-west2'[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.DATAFLOW_YAML_JOB_NAME = ''[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.BQ_DATASET = ''[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.BQ_INPUT_TABLE = ''[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.BQ_OUTPUT_TABLE = ''[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.DATAFLOW_YAML_PIPELINE_FILE_URL = 'gs://airflow-system-tests-resources/dataflow/yaml/example_beam_yaml_bq.yaml'[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.BQ_VARIABLES_DEF[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.INSERT_ROWS_QUERY = "INSERT . VALUES ('John Doe', 900, 'USA'), ('Alice Storm', 1200, 'Australia'),('Bob Max', 1000,...[来源]¶

tests.system.google.cloud.dataflow.example_dataflow_yaml.create_bq_dataset[来源]¶