Apache Beam 101 | BigData | Google DataFlow | Learn Apache Beam in 1 hour | By Viswateja
In this video, we will Learn What is Big Data, ETL ( Extraction Transformation and Loading), and Apache Beam a Big Data tool.
0:00 - What is Big Data
06:06 - What is ETL
07:42 - What is Apache Beam
12:15 - Built-in I/O transformations
15:15 - PCollections
18:00 - Reading a file and Apache Beam SDK configuration in Google Colab
31:36 - Custom Functions
34:23 - GroupBy/Aggregations
38:24 - P collections in-memory
40:41 - Map and Filter
42:22 - Aggregations With Multiple Keys
46:05 - Combine Per Key
48:26 - Combine Per-Key vs Count Per Key
50:24 - Writing a CSV file
52:30 - Composite Transformation
59:37 - Pardo
01:05:33 - Pardo Side Inputs
01:07:46 - Pardo Side Outputs