Beam SDK's don't have to look the same - Beam Summit 2024
Do we even need PCollections? Or ProcessElements? Can we have the language fully typecheck the pipeline for us at compile time? Can we do that in Go?
Since Beam was designed, programming languages have continued to evolve and change, so why can’t our SDKs? We’ve now got ample experience with the Apache Beam Go SDK, but the language it was designed for is now very different.
This short talk will compare the current Go SDK with an experimental implementation that takes better advantage of the current strengths of Go, and its approach to generic type parameters, and more.