Beam Summit 2022 - Splittable DoFns In Python: A Hands-On Workshop
In this workshop, Israel, Strategic Cloud Engineer at Google Cloud, and Miren, Cloud Consultant at Google, review the concept of Splittable DoFns and write two I/O connectors using this kind of DoFns: one in batch (for reading large files in a given format), and one for streaming (for reading from Kafka topics). They run some examples on Google Cloud Dataflow after implementing these connectors from scratch during the workshop. All the code will be written in Python.