Use Dataproc Serverless for Spark to Load BigQuery| Google Cloud Platform|Professional Data Engineer
Dataproc Serverless is a fully-managed service that makes it easier to run open source data processing and analytics workloads without the need to manage infrastructure or manually tune workloads.
Dataproc Serverless for Spark provides an optimized environment designed to easily move existing Spark workloads to Google Cloud.
In this lab you will run a Batch workload on Dataproc Serverless environment. The workload will use a Spark template to process an Avro file to create and load a BigQuery table.
What you'll do
Configure the environment
Download lab assets
Configure and execute the Spark code
View data in BigQuery