How to Build a Data Pipeline with Google BigQuery, DBT, and Supermetrics
Join us for a high level overview of how to set up a reporting data pipeline as we walk through the strategy and tools to make it happen. You'll see how to pull in marketing data, custom data from your organization (like client lists, management fees, and custom insights), analyze it and visualize it using the blazing fast BigQuery engine.
This hangout is based in large part on The Coding is for Losers Agency Data Pipeline Course and a method taught to us by Nico Brooks from Two Octobers.
On this episode we walk through how to set up a solution that gathers data in Google Sheets with Supermetrics. We then use the Google Sheets tabs as external tables in BigQuery. We then use a killer tool called DBT from Fishtown Analytics to build an aggregated reporting table in BigQuery that we can then visualize in Google Data Studio.
We were super Lucky to have Lee Hurst (@Helpfullee on Twitter), a Google Data Studio Expert join us on the episode. He shared a number of ingenious hacks with us at the end of the hangout.
Resources:
-- Build your Agency Data Pipeline course from Coding is for Losers: https://learn.codingisforlosers.com/a...
-- Supermetrics for Sheets Add-on for pulling marketing data into Google Sheets: https://supermetrics.com/product/goog...
-- DBT, our tool for pulling data from Sheets into BigQuery: https://www.getdbt.com/
-- DBT Docs: https://docs.getdbt.com/
-- DBT tutorial Project: https://docs.getdbt.com/tutorial/sett...
-- Google BigQuery Documentation: https://cloud.google.com/bigquery/docs
-- How to Build a BigQuery Project: https://cloud.google.com/appengine/do...