Also thank you, of course, to Confluent, for sponsoring me and supporting me with both time and technical expertise while I worked on this book (note: I work for Confluent now, but didn't when I wrote the first edition).
I'd like to thank everyone at O'Reilly for everything they've done to make this book a reality. They have some of the best editors, production managers, and content reviewers that I've ever worked with.
(con't) New content includes (but not limited to):
- A major revision to building, managing, and deploying services in the age of cloud computing (remember, I started the first book in 2017: 8 years ago).
- How to handle bad data in event streams.
New content includes (but not limited to):
- An extensive focus on event design, including types of events, schema usage, mapping to streams, and changes through time.
- A major revision of the types of frameworks you can use to build your event-driven services.
You can also find it as an ebook PDF from Confluent (www.confluent.io/resources/eb...) , or printed in paper on various online sellers starting in mid-to-late October.
It's DONE. SHIP IT.
Finished my 2nd edition of Building Event-Driven Microservices, published by @oreilly.bsky.social and sponsored by the good people at @confluent.io.
You can find this book on the O'Reilly learning platform (www.oreilly.com/library/view... - you get a free trial!),
Pretty slick blog from my (new!) colleague Gunnar Morling. Check out GraalVM for native binaries with Kafka
How many times does your organization process the same data?
@abellemare.bsky.social introduces a shift left approach, minimizing duplication by processing data once and making it accessible across different use cases. Read here: https://www.infoq.com/articles/rethinking-medallion-architecture/
$1.5B for less than $20M ARR? Yikes. Is this a repeat of Databricks buying Tabular?
Apologies for the late reply - I was on vacation and unplugged!
Shift left is makes data readily available to whatever systems need it. Streams get it there in near-realtime. Iceberg Table into Silver layer is slower and typically part of a data lake. It may or may not be suitable for operations
My new post is available on InfoQ. The bronze age is over! Rethink the medallion architecture.
www.infoq.com/articles/ret...
Building Event-Driven Microservices 2nd Edition is a go!
It's an ambitious release date, targeting the end of this year. 😬
Round - the warmest of shapes!
Man, I sure do love the Gulf of Mexico. Check out that Mexico Basin!
Gotta keep those AI models warm with something...
I'm thinking of writing a second edition of Building Event-Driven Microservices. Any requests for specific subjects to tackle?
Since we're kicking things off around here, again, I may as well find the rest of my fellow Kafka fans:
It's rough out there. Know the signs. Know what your loved ones are saying about #apacheKafka.
Hey look - AWS just released managed Apache Iceberg tables.
aws.amazon.com/about-aws/wh...
And the winner is: Apache Iceberg!
Please commence the flame wars in the comments below.
www.bigdatawire.com/2024/12/03/h...
S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s...
I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets.
#databs
The deep goal of bluesky is to decentralize the social internet so that every individual controls their experience of it rather than having it be controlled by 5 random billionaires. Everyone thinks they signed up for a demuskified twitter...we actually signed an exciting and bizarre experiment.
My colleagues at Confluent just put out this video. I'm sharing because it's an homage to Wes Anderson, but also... really cool pastel colors, sets, vintage computers, and a mention to one of my favourite Canadian places, Victoria Island, BC!
www.youtube.com/watch?v=IQ3V...
Thansk Andrew. I have a few more parts coming out yet (maybe 2, definitely 1), so stay tuned.
Just published part II of "How to Design Event Streams". Check it out here.
They're popping up like mushrooms after a rain!
It's good to see the Kafka API is so widely adopted though, and the de-facto standard.
Hey cool, I made #2 this month: www.datacouncil.ai/blog/novembe...
I wrote about how to deal with (and prevent) bad data in your event stream. It's on my company's blog: www.confluent.io/blog/shift-l...
Great post by my friend Jack - check it out.
Agreed. Here's hoping it holds out.
Can't say I'm surprised. I remember the days when Twitter was actually good - it's sure been a long time.
Repost Wednesday:
Data Products, Shift-Left, and Streams - how does it all fit together? In this post, I go into depth on how you can build a data product using event streams, schemas, and Flink.
www.confluent.io/blog/impleme...
