For more details, check the "What's new in Apache Spark 4.0.0 - Arbitrary state API v2 - batch"
👉 https://www.waitingforcode.com/apache...
Chapters:
0:00 Introduction
0:53 Demo - transformWithState simple
3:42 Demo - transformWithState incremental processing
6:20 Summary