Apache Kafka 3.1 - What’s New & What missed the Cut

Опубликовано: 02 Май 2026
на канале: Data Engineering with Izzy
230
7

What’s New in Apache Kafka 3.1

In this video, we walk you through the new features that have just been added to Apache Kafka in the 3.1.0 release. This was an amazing effort by 100+ community contributors. The video covers the key KIPs for Kafka Core, Clients, Streams and MirrorMaker and then briefly goes over some of the highly anticipated KIPs for future Kafka releases that missed the cut for 3.1

Chapters in this Video
00:00 Overview of New Features
00:53 Outline of Release Announcement
01:31 New Features for Kafka Core and Clients
01:42 KIP-748: Add Broker Count Metrics
02:52 KIP-768: Extend SASL/OAUTHBEARER with Support for OIDC
04:05 New Features for Kafka Streams
04:16 KIP-633: Deprecate 24-hour Default Grace Period for Windowed Operations
06:35 KIP-761: Add Total Blocked Time Metric to Streams
07:10 KIP-763: Range queries with open endpoints (ReadOnlyKeyValueStore)
07:21 KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore (ReadOnlySessionStore/ReadOnlyWindowStore)
08:43 KIP-775: Custom partitioners in foreign key joins
09:13 KIP-783: Add TaskId field to StreamsException
09:27 New Features for Mirror Maker
09:45 KIP-690: Add additional config to control MM 2 internal topics naming convention
10:25 Some Key Important KIPs that Missed the Cut
10:37 KIP-405: Kafka Tiered Storage
11:48 KIP-618: Exactly-Once Support for Source Connectors
12:04 KIP-653: Upgrade log4j to log4j2
12:31 KIP-708: Rack awareness for Kafka Streams

Kafka 3.1.0 Release Blog Post
​​https://blogs.apache.org/kafka/

Kafka 3.1.0 Release Plan
https://cwiki.apache.org/confluence/d...

Get 10% off with promo code IZZY10
Course on Massive Data Workloads with Open Source Software
https://bit.ly/3qx5VPi

Join our Community on Patreon
  / izzyacademy