Creating a Streaming Data Pipeline for a Real Time Dashboard with Dataflow|Professional DataEngineer
In this lab, you own a fleet of New York City taxi cabs and are looking to monitor how well your business is doing in real-time. You build a streaming data pipeline to capture taxi revenue, passenger count, ride status, and much more, and then visualize the results in a management dashboard.
Objectives
In this lab you learn how to:
Create a Dataflow job from a template
Stream a Dataflow pipeline into BigQuery
Monitor a Dataflow pipeline in BigQuery
Analyze results with SQL
Visualize key metrics in Looker Studio