The Dodgy State of Delivery Guarantees
Learn about delivery guarantees in stream processing, how I believe the terms that we use to describe them are misleading, and how you can avoid the bugs and misconceptions that result from this great injustice.
I'm not trying to scare anyone away from stream processing, in fact a lot of the issues outlined also apply to automated batch processing systems as well. Personally, I think that being realistic and pragmatic about failure conditions makes these systems less intimidating.
0:00 Intro
0:55 What are delivery guarantees?
4:37 Not all at-least-once is equal
10:56 Unhelpful focus on delivery
18:19 Kafka auto-commit
21:53 Out-of-order acknowledgement
30:12 Summary
31:19 Exactly-once delivery