Beam Summit 2022 - Error handling with Apache Beam and Asgarde library
Session presented by Mazlum Tosun at Beam Summit 2022
Mazlum, Tech lead GCP and data, and FP and GCP enthusiast, created a library for error handling with Apache Beam Java and Kotlin. Asgarde allows error handling with less code and more concise/expressive code. The purpose is to show Beam native error handling with Asgarde Java.
He also shows Asgarde Kotlin with even more concise code and a more functional style.
The example with Asgarde stores the bad sink in a Bigquery table (DLQ).
L'Oréal, Mazlum's actual big customer, used Asgarde in production code. He explains how it was essential for them to treat errors. https://github.com/tosun-si/asgarde/