Kafka Streams's Avatar

Kafka Streams

@kafkastreams

The official Apache Kafka Streams account. Run by the Apache Kafka PMC. Long live the otter.

121
Followers
26
Following
29
Posts
20.12.2024
Joined
Posts Following

Latest posts by Kafka Streams @kafkastreams

We are happy to announce that Viktor Somogyi-Vass accepted our invitation to join the PMC.

Congratulations Viktor!

23.02.2026 18:15 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

We are happy to announce that Andrew Schofield accepted our invitation to join the PMC.

Congratulations Andrew!

23.02.2026 00:16 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

We are happy to announce that Christo Lolov accepted our invitation to join the PMC.

Congratulations Christo!

23.02.2026 00:13 ๐Ÿ‘ 3 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

We are happy to announce that Kamal Chandraprakash accepted our invitation to join the PMC.

Congratulations Kamal!

22.02.2026 17:47 ๐Ÿ‘ 1 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

We are happy to announce that Lianet Magrans accepted our invitation to join the PMC.

Congratulations Lianet!

21.02.2026 23:01 ๐Ÿ‘ 3 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Fixed

21.02.2026 00:01 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Curious to see where we will go next!

In the meantime: checkout โ€œstreamsโ€ groups and let us know what you think!

21.02.2026 00:01 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Itโ€™s also a release with major code changes for KS broker side, ie, adding task assignment logic to the group coordinator.

While brokers did get smaller features for KS in the past, the only major feature designed with KS in mind in the past were transactions.

\2

21.02.2026 00:01 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

The recent 4.2 release is one of the largest milestones for Kafka Streams so far. The new โ€œstreamsโ€ groups introduce Kafka Streams specific RPCs into the protocol, making Kafka Streams more than just a wrapper around consumer/producer clients, and a first class citizen.

\1

21.02.2026 00:00 ๐Ÿ‘ 7 ๐Ÿ” 1 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Apache Kafka 4.2.0 Release Announcement We are proud to announce the release of Apache Kafkaยฎ 4.2. This release contains many new features and improvements. This blog post will highlight some of the more prominent ones. For a full list of c...

We are happy to announce Apache Kafka 4.2.0!

Highlights are: Queues for Kafka and the new #KafkaStreams "streams" groups.

Thanks to all the 155 contributors and our RM Christo Lolov.

More details on the web page:
kafka.apache.org/blog/2026/01...

17.02.2026 17:31 ๐Ÿ‘ 1 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Souquieres Adam โ€“ Medium Read writing from Souquieres Adam on Medium. Writing about production streaming and data systems. Focus on trade-offs, not trends. Experience-based, not promotional.

Great stuff about Kafka Streams! Check it out!

medium.com/@souquieres....

14.02.2026 03:42 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

There is a new KIP-1244 proposing to deprecate the Kafka Streams Scala API, and remove it with the next major release.

Please join the discussion on the dev mailing list if this concerns you.

13.01.2026 18:19 ๐Ÿ‘ 1 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Video thumbnail

๐Ÿš€ I've built a new interactive simulation of #Kafka Streams, showcasing state stores!

See state stores being restored, switch between RocksDB & in-memory state store behavior,restart tasks. Great for understanding or explaining Kafka Streams!

Try it here: kafkastreamsfieldguide.com/tools/state-...

02.12.2025 12:22 ๐Ÿ‘ 11 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available!

It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...

Thanks to 32 contributors and Lianet Magrans as our RM.

14.11.2025 17:56 ๐Ÿ‘ 4 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Colocating Input Partitions with Kafka Streams When Consuming Multiple Topics: Sub-Topology Matters! Understanding how sub-topology design influences partition co-location

Sub-topologies and co-partitioning are imported concepts. Nice blog post from Expedia:

medium.com/expedia-grou...

11.11.2025 20:10 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!

Thanks to 53 contributors and your RM Christo Lolov.

For more details, checkout the announcement:
kafka.apache.org/blog#apache_...

13.10.2025 19:40 ๐Ÿ‘ 5 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

๐ŸšจKafka Streams 4.1.0 contains a memory leak regression bug: issues.apache.org/jira/browse/...

Be careful upgrading, or wait for 4.1.1 bug-fix release. We plan to get it out quickly.

06.10.2025 19:10 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 2

Any KIP-1071 experience out there?

Asking for a friend.

30.09.2025 02:34 ๐Ÿ‘ 2 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

๐Ÿšจ Breaking News from Community Over Code ๐Ÿšจ

Introducing The ASFโ€™s New Logo buff.ly/DzgT82w

#CommunityOverCode #opensource

11.09.2025 15:12 ๐Ÿ‘ 26 ๐Ÿ” 18 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 2
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

Apache Kafka 4.1.0 was release!

Most exciting, the new โ€œstreamsโ€ rebalance protocol is available as early access.

We are happy to announce the Apache Kafka 4.1.0 release!

Please try it out, and let us know how it goes!

kafka.apache.org/blog#apache_...

04.09.2025 17:23 ๐Ÿ‘ 5 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!

28.07.2025 23:09 ๐Ÿ‘ 3 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...

20.05.2025 13:17 ๐Ÿ‘ 6 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB

This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource

10.06.2025 15:18 ๐Ÿ‘ 8 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

KIP-1112: cwiki.apache.org/confluence/d...

Injecting custom boiler plate code into all Processors is now easily possible, via this new โ€œprocessor wrapperโ€ concept. Useful for PAPI users, but invaluable for the DSL!

\6

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

KIP-1106: cwiki.apache.org/confluence/d...

This is a shared KIP for the consumer and Kafka Streams. A new auto.offset.reset policy โ€œby durationโ€ is added. Very useful for tiered storage setups when you donโ€™t want to use โ€œearliestโ€ but still want to start at some point in the past.

\5

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

KIP-1104: cwiki.apache.org/confluence/d...

Foreign-key table-table joins are very popular. However, the FK could only be extracted from the value so far. This unnecessary limitation is gone now, by passing in both key and value into the FK-key extractor.

\4

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

KIP-1091: cwiki.apache.org/confluence/d...

Letโ€™s make KIP-1076 even more useful. A few key metrics like client-state and thread-state are Strings and thus cannot be collected via KIP-714. This KIP adds numerical twins for these metrics to make them collectible!

\3

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

KIP-1076: cwiki.apache.org/confluence/d...

This is an extension to the famous KIP-714. We now allow to register user metrics for broker side collection. Kafka Streams uses these new APIs to register its own metrics, so all Kafka Streams metrics can now be collected broker side.

\2

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.

KIP-1065: cwiki.apache.org/confluence/p...

The ProductionExceptionHandler becomes more flexible. Itโ€™s now also called for retriable errors. This allows you to break (previously infinite) retry loops.

\1

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 1 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 1

There is a few more others which are more minor. So we stick with these highlights for now. If you want to know them all (also for older releases), check out the wiki: cwiki.apache.org/confluence/d...

Thatโ€™s a wrap!

\TheEnd

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0