Decodable

Bridging Flink SQL and Custom Java Pipelines with the Decodable SDK How to build a multi-stage, real-time data pipeline combining the flexibility of Apache Flink jobs in Java with the declarative nature of Flink SQL jobs.

📝 𝗕𝗟𝗢𝗚𝗚𝗘𝗗 👨‍💻

In my latest article I explore how to 𝗰𝗼𝗺𝗯𝗶𝗻𝗲 𝘁𝗵𝗲 𝗳𝗹𝗲𝘅𝗶𝗯𝗶𝗹𝗶𝘁𝘆 𝗼𝗳 𝗰𝘂𝘀𝘁𝗼𝗺 #ApacheFlink 𝗷𝗼𝗯𝘀 𝘄𝗿𝗶𝘁𝘁𝗲𝗻 𝗶𝗻 #Java 𝘄𝗶𝘁𝗵 𝘁𝗵𝗲 𝗰𝗼𝗻𝘃𝗲𝗻𝗶𝗲𝗻𝗰𝗲 𝗮𝗻𝗱 𝗱𝗲𝗰𝗹𝗮𝗿𝗮𝘁𝗶𝘃𝗲 𝗻𝗮𝘁𝘂𝗿𝗲 𝗼𝗳 #FlinkSQL.

Learn how to build a real-time, multi-stage pipeline running on @decodable.co.👇

www.decodable.co/blog/bridgin...

At @decodable.co we recently added #ScaleToZero, an extremely popular feature mostly because of these 3 reasons:

⏱️ Latency Tolerance
💰 Resource Efficiency
🧠 Intelligent Triggers

Blog post 📝 is here www.decodable.co/blog/stream-....

I created this little video 📺 to see it in action 🎬

📝 Just blogged: "Get Running with Apache Flink on Kubernetes"

Part one of a series of two, exploring in depth how to run Flink jobs with the Flink Kubernetes operator. This was fun, learned a lot while writing it 🤓! Part two due next week.

www.decodable.co/blog/get-run...

📝 BLOGGED: In this article I'm discussing why #data #lineage is crucial for #realtime pipelines. A simple example
shows how @decodable.co's #interactive lineage graph aids end-to-end #visibility 👁️ and #control 🎛️

www.decodable.co/blog/lineage...

📝 BLOGGED: In this article I'm touching upon the importance and usefulness of 🏷️ #tagging to keep #realtime data pipelines manageable at scale. It shows how @decodable.co's fully-managed #datastreaming platform provides 1️⃣st-class support for resource tagging.

www.decodable.co/blog/resourc...

Woot, woot, thank you so much, Chris!

Decodable is slowly getting closer to the CDC data platform I've always wanted.

Last month on Write that blog! …
- “Zero Disk Architecture” by @avi.im
- “Blogging Through the Decades” by @bcantrill.bsky.social
- “Revisiting the Outbox Pattern” by @gunnarmorling.dev (@decodable.co)
- “Userland Disk I/O” by @alexmillerdb.bsky.social

writethat.blog?year=2024&mo...

A whimsical illustration split into two panels. The left panel features a cute, blue elephant with closed eyes, standing on a snowy ground. The elephant is blowing snowflakes and sparkles from its trunk into the right panel. The background is dark with hanging stars and geometric shapes. The right panel shows a large, intricate snowflake surrounded by swirling snow and sparkles against a blue background, with abstract tree shapes below.

One of the most common things I see people asking how to do is get data from #Postgres to #Snowflake, so I wrote a blog post about how to do with @decodable.co. You can use a web UI or YAML—your choice.

✍️ dcbl.link/postgres-to-...

#dataBS

Hello 🦋! Happy Friday, and stream on!