Cloud Composer Copying BigQuery Tables Across Different Locations
Skill Badge: Engineer Data in Google Cloud
Overview
In this advanced lab, you will learn how to create and run an Apache Airflow workflow in Cloud Composer that completes the following tasks:
Reads from a config file the list of tables to copy
Exports the list of tables from a BigQuery dataset located in US to Cloud Storage
Copies the exported tables from US to EU Cloud Storage buckets
Imports the list of tables into the target BigQuery Dataset in EU
My LinkedIn: / jeet-patel-b7a90316a