The Streaming Otter's Avatar

The Streaming Otter

@thestreamingotter

The unoffical Apache Kafka Streams account. Long live the otter.

113
Followers
142
Following
20
Posts
28.10.2024
Joined
Posts Following

Latest posts by The Streaming Otter @thestreamingotter

There is a new KIP-1244 proposing to deprecate the Kafka Streams Scala API, and remove it with the next major release.

Please join the discussion on the dev mailing list if this concerns you.

13.01.2026 18:19 ๐Ÿ‘ 1 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Reimagining Stream Processing with Matthias J. Sax | Ep. 9 Podcast Episode ยท Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov ยท 11/17/2025 ยท 37m

This was fun! Thanks @gamussa.dev for having me.

podcasts.apple.com/us/podcast/c...

18.11.2025 15:40 ๐Ÿ‘ 6 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
A deep dive into Apache Kafka's KRaft protocol | Red Hat Developer Learn about the Apache Kafka's KRaft protocol, a consensus algorithm that ensures fault tolerance and consistency in a network of interconnected nodes

A deep dive into Apache Kafka's KRaft protocol
developers.redhat.com/articles/202... - Good article from Federico Valeri

18.11.2025 16:27 ๐Ÿ‘ 9 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Kafka Streams News - November 2025 | Kafka Streams Field Guide Book Latest news and content from the Kafka Streams community for November 2025

Just published my #KafkaStreams news summary! ๐Ÿ”ฅ
Highlights: 4.1.1 bug-fix release, upcoming DLQ feature for Kafka Streams, new Streams UI in Confluent Cloud, Current sessions, & more.
kafkastreamsfieldguide.com/articles/kaf...
#ApacheKafka

17.11.2025 10:57 ๐Ÿ‘ 1 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available!

It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...

Thanks to 32 contributors and Lianet Magrans as our RM.

14.11.2025 17:56 ๐Ÿ‘ 4 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Data Streamign Awards Winner | Michelin Winner of the 2025 Data Modernization and Contribution award

Also congrats to our friends from Michelin.

Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.

#Current #DataStreamingAwards

current.confluent.io/data-streami...

31.10.2025 08:04 ๐Ÿ‘ 4 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

I've built a Core Insights dashboard for #Kafka Streams! ๐Ÿ“Š

This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents.
#dataengineering

kafkastreamsfieldguide.com/articles/kaf...

27.10.2025 07:40 ๐Ÿ‘ 5 ๐Ÿ” 2 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Preview
Life Is But A Stream Podcast Hosted by Joseph Morais Life Is But A Stream is a web show and podcast for tech leaders looking to harness real-time data streaming to accelerate innovation and drive business impact.

#KafkaStreams is at the core of Metronome.

"There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB."

A very advanced deployment requiring careful engineering. But the library approach shines!

Check it out.

cnfl.io/3WPoAGE

05.11.2025 01:43 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Kafka Streams Field Guide | Kafka Streams Field Guide Book

๐Ÿš€ Announcing the Kafka Streams Field Guide! Iโ€™m writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at kafkastreamsfieldguide.com and get 2 free chapters! #ApacheKafka

30.09.2025 15:25 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Preview
The Past and Present of Stream Processing (Part 13): Kafka Streamsโ€Šโ€”โ€ŠA Lean and Agile Kingโ€™s Army Introduction

taogang.medium.com/the-past-and...

15.10.2025 15:59 ๐Ÿ‘ 3 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1
Preview
Monitor Kafka Streams Health in Confluent Cloud Quickly troubleshoot Kafka Streams apps with new health metrics in Confluent Cloud. Spot bottlenecks, monitor RocksDB, and reduce MTTRโ€”no extra code.

Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud.

We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.

Check it out and let us know what you think!

www.confluent.io/blog/monitor...

14.10.2025 16:27 ๐Ÿ‘ 6 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!

Thanks to 53 contributors and your RM Christo Lolov.

For more details, checkout the announcement:
kafka.apache.org/blog#apache_...

13.10.2025 19:40 ๐Ÿ‘ 5 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Oh-oh!

07.10.2025 19:31 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Any KIP-1071 experience out there?

Asking for a friend.

30.09.2025 02:34 ๐Ÿ‘ 2 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

๐Ÿš€ Yesterday, we announced that ๐—ฅ๐—ฒ๐˜€๐˜๐—ฎ๐˜๐—ฒ ๐—–๐—น๐—ผ๐˜‚๐—ฑ is now publicly available. Today, weโ€™re announcing ๐—ฅ๐—ฒ๐˜€๐˜๐—ฎ๐˜๐—ฒ ๐Ÿญ.๐Ÿฑ!

This release brings key features for building, controlling and observing your durable agents and workflows.

01.10.2025 14:51 ๐Ÿ‘ 7 ๐Ÿ” 2 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 1

The #ApacheKafka Java clients and #KafkaStreams engineering team at @confluent.io keeps growing.

Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!

We also have one more entry level position in Toronto ๐Ÿ‡จ๐Ÿ‡ฆ

careers.confluent.io/jobs/job/67c...

10.09.2025 00:39 ๐Ÿ‘ 2 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Responsive | Kafka Streams Vault We're no longer actively developing or maintaining our Kafka Streams content. Visit our GitHub repository for archived blog content.

๐Ÿ˜ข

www.responsive.dev/ks-archive

10.09.2025 00:41 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1
Preview
Apache Kafka Apache Kafka: A Distributed Streaming Platform.

Apache Kafka 4.1.0 was release!

Most exciting, the new โ€œstreamsโ€ rebalance protocol is available as early access.

We are happy to announce the Apache Kafka 4.1.0 release!

Please try it out, and let us know how it goes!

kafka.apache.org/blog#apache_...

04.09.2025 17:23 ๐Ÿ‘ 5 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!

28.07.2025 23:09 ๐Ÿ‘ 3 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

The schedule is now available for Community Over Code North America, and early bird registration ends June 28. We hope you'll join the ASF community in Minneapolis Sept 11-14! buff.ly/4b8kciW

#CommunityOverCode #opensource

17.06.2025 19:00 ๐Ÿ‘ 4 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Insane amount of SlateDB work going on:

- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing

And someone just pushed Python bindings in a PR! ๐Ÿคฏ

18.06.2025 14:48 ๐Ÿ‘ 9 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB

This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource

10.06.2025 15:18 ๐Ÿ‘ 8 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1
Post image

Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...

20.05.2025 13:17 ๐Ÿ‘ 6 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Kafka Consumer Offsets Guideโ€”Basic Principles, Insights & Enhancements Learn how to achieve data consistency and reliability with a complete Apache Kafka consumer offsets guide covering key principles, offset management, and KIP-1094 innovations.

New blog post alert! My colleague Alieh Saeedi digs into the guts of manual consumer offset commits, and the improvements of KIP-1094 (AK 4.0) about it.

Outstanding work!

Enjoy the read and change your code. You most likely do it wrong right now!

www.confluent.io/blog/guide-t...

22.04.2025 15:04 ๐Ÿ‘ 3 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
SlateDB - An embedded storage engine built on object storage | SlateDB Description will go into a meta tag in <head />

Today marks SlateDBโ€™s one year anniversary! Itโ€™s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. ๐Ÿ˜€

22.04.2025 21:55 ๐Ÿ‘ 16 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

We are having two more (early career) open positions in our team, Java clients & #KafkaStreams (๐Ÿ‡จ๐Ÿ‡ฆ). If working on distributed data systems and stream processing sounds interesting to you, please apply: careers.confluent.io/jobs/1518441...

We have also not closed the other two positions yet:

23.04.2025 00:51 ๐Ÿ‘ 8 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
IntelliJ IDEA Conf 2025 | June 3-4, 2025 We invite you to join us for IntelliJ IDEA Conf 2025 and gain insights from industry leaders and experts.

Looking forward to @sharatchander.bsky.social 's Keynote. Then, looking forward to hearing @gamussa.dev talking about Kafka and the Schema Registry, and then more!

Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!

lp.jetbrains.com/intellij-ide...

@jetbrains.com

22.04.2025 15:52 ๐Ÿ‘ 5 ๐Ÿ” 2 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.

KIP-1065: cwiki.apache.org/confluence/p...

The ProductionExceptionHandler becomes more flexible. Itโ€™s now also called for retriable errors. This allows you to break (previously infinite) retry loops.

\1

05.04.2025 05:40 ๐Ÿ‘ 1 ๐Ÿ” 1 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 1
Preview
Kafka Streams Cost Calculator | Estimate Your Kafka Streams Application Costs Free tool to analyze and estimate the costs of running Kafka Streams applications. Calculate compute, storage, and operational costs for your Kafka Streams deployment.

Interesting.

www.kafkastreams.money

29.03.2025 16:52 ๐Ÿ‘ 5 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 1

We have two open (early career) engineering positions in our team (Canada ๐Ÿ‡จ๐Ÿ‡ฆ)

If you are excited about contributing to #ApacheKafka with a focus on Java client and @kafkastreams.bsky.social this might be the right fit for you

careers.confluent.io/jobs/1581205...
careers.confluent.io/jobs/1580808...

28.03.2025 06:42 ๐Ÿ‘ 10 ๐Ÿ” 6 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1