Delta Lake

📣 In case you missed it!

We recently hosted a deep dive on how 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗧𝗮𝗯𝗹𝗲𝗳𝗹𝗼𝘄 and the 𝗗𝗲𝗹𝘁𝗮 𝗞𝗲𝗿𝗻𝗲𝗹 automate the move from Kafka to Databricks Unity Catalog—eliminating the need for fragile, manual ETL.

🎥 Catch the full replay on YouTube: youtube.com/live/Q8yxLKh...

#opensource #deltalake

Delta Lake: The Definitive Guide 🎉 1 Year Anniversary Virtual Celebration! · Luma 🎉 Delta Lake: The Definitive Guide - 1 Year Anniversary Virtual Celebration! We are thrilled to invite you to a special virtual event celebrating the one-year…

1 WEEK AWAY ➡️ 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲: 𝗧𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲 - 𝟭 𝗬𝗲𝗮𝗿 𝗔𝗻𝗻𝗶𝘃𝗲𝗿𝘀𝗮𝗿𝘆 𝗩𝗶𝗿𝘁𝘂𝗮𝗹 𝗖𝗲𝗹𝗲𝗯𝗿𝗮𝘁𝗶𝗼𝗻! 🎉

Join us next Wednesday, December 17th, as we celebrate a huge milestone: the one-year anniversary of the publication of Delta Lake: The Definitive Guide! 🙌

🔗 Secure your spot: luma.com/1yearcelebra...

#oss

Delta Lake: The Definitive Guide 🎉 1 Year Anniversary Virtual Celebration! · Luma 🎉 Delta Lake: The Definitive Guide - 1 Year Anniversary Virtual Celebration! We are thrilled to invite you to a special virtual event celebrating the one-year…

🎉 It’s been one year since the release of 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲: 𝗧𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲, and we’re throwing a virtual party to celebrate the milestone!

🔹 𝗖𝗲𝗹𝗲𝗯𝗿𝗮𝘁𝗲 𝘁𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲
🔹 𝗔𝘀𝗸 𝗨𝘀 𝗔𝗻𝘆𝘁𝗵𝗶𝗻𝗴 (𝗔𝗨𝗔)
🔹 𝗦𝘄𝗮𝗴 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆

📅 Dec 17
⏰ 9:00AM PT
🔗 Register: luma.com/1yearcelebra...

#deltalake #opensource #oss

Flight SQL + Delta: Building the Future of High-Speed Data Exchange · Luma Join us for an in-depth, interactive session on Flight SQL and Delta integration, showcasing how open technologies like Apache Arrow Flight, DataFusion, and…

We’re diving deep into Flight SQL + Delta to show how open technologies like Apache Arrow Flight, #DataFusion, & Delta Lake are reshaping high-performance analytics. 🚀

🗓️ Nov 11
🕝 9:00 AM PT
🔗 RSVP: luma.com/delta-1111

Get ready to see data exchange the way it should be — fast, distributed, & open.

Did you know you can easily enable Variant Type in existing Delta tables? 💡 Just run an ALTER TABLE command to activate the Delta feature: `variantType`.

Watch the full webinar ➡️ www.youtube.com/live/0BfUG2P...

#DeltaLake #OpenSource #OSS

Open Lakehouse + AI · Events Calendar View and subscribe to events from Open Lakehouse + AI on Luma. Open Lakehouse + AI is a global community advancing open lakehouse and AI through adoption, sharing real-world use cases, and collaborati...

What’s next?​
🔹 October 30: Webinar — The Failed Promises of Data Lineage: Why More Metadata Isn’t the Answer​
🔹 November 13: Mini Summit — Mountain View​
🔹 November 24: Meetup — Paris​

🔗 RSVP and details: luma.com/openlakehouse

#opensource #oss #openlakehouse #ai #ducklake #duckdb

Open Lakehouse + AI spotlight: @hannes.muehleisen.org shares how anyone can contribute to DuckDB & DuckLake—both MIT-licensed, open source, & welcoming PRs and community engagement on GitHub.

Check out this clip to hear how easy it is to get involved and start contributing today. 🚀

#openlakehouse

Diving into Streaming Data Design Patterns for Delta Lake · Luma Are you wondering if general concepts like data engineering design patterns can help you learn about Delta Lake? Or, if it's possible to leverage Delta Lake…

⏰ Final reminder: Delta Lake webinar tomorrow!

Can data engineering patterns unlock new Delta Lake insights? How can it power streaming architectures?

Join Scott Haines & Bartosz Konieczny as they tackle these questions head-on!

🔗 RSVP: luma.com/delta-1014

#opensource #oss #deltalake #streaming

The Failed Promises of Data Lineage: Why More Metadata Isn’t the Answer · Luma The data world doesn’t need more lineage graphs. Most are overly complex and lack meaningful context. After years of chasing “total visibility,” we’ve learned…

📣 Join us for our next 𝗢𝗽𝗲𝗻 𝗟𝗮𝗸𝗲𝗵𝗼𝘂𝘀𝗲 + 𝗔𝗜 webinar on October 30 at 9AM PT!

Lineage graphs are complex and low-context. Collecting isn’t the problem—understanding is. Learn how a reasoning layer connects lineage + telemetry into continuous context.

RSVP ➡️ luma.com/openlakehous...

#openlakehouse

One of the most powerful new capabilities in Delta Lake 4.0 is support for collations, giving you much finer control over how text is compared and sorted. ✅

In this clip, Youssef Mrini explains how to enable collations.

🎥 Watch the full webinar: youtube.com/live/0BfUG2PZyNs?si=nzcalgk1gvOEFBrY

Diving into Streaming Data Design Patterns for Delta Lake · Luma Are you wondering if general concepts like data engineering design patterns can help you learn about Delta Lake? Or, if it's possible to leverage Delta Lake…

One week to go! 🥳 Curious how data engineering design patterns translate to Delta Lake, & how it fits into streaming architectures?

Join us for a walkthrough of the patterns, features, & best practices powering reliable streaming with #DeltaLake.

🗓️ Oct 14
🕝 9AM PT
🔗 RSVP: luma.com/delta-1014

#oss

From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future · Zoom · Luma The lakehouse promises a unified platform for analytics, ML, and governance. While modern catalogs offer unified governance, the same uniformity is still…

Tomorrow, Oct 7 at 9AM PT! Join Ciro Greco & Jacopo Tagliabue from bauplan for a live webinar on how function-based execution & Git-for-Data are reshaping lakehouses for autonomous AI agents. ✅

Don’t miss the future of agentic data ops!

Secure your spot ➡️ luma.com/OLAI-107

#opensource #lakehouse

Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 YouTube video by Delta Lake

🎥 Explore a detailed walk-through and the expanded feature set of Delta 4 in this webinar: www.youtube.com/live/0BfUG2P...

#opensource #oss #deltalake #JVM #spark #rust #go

Delta Connect is a plugin atop Spark Connect, introduced in Spark 3.4, and enables gRPC communication using Protocol Buffers. ✅ This allows client implementations in languages such as Rust and Go to interact with Spark outside the JVM, provided they support the protocol.

#opensource #oss #deltalake

🔹 Oct 7: Webinar — From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future
🔹 Nov 13: Mini Summit | Mountain View, CA
🔹 Nov 24: Open Lakehouse + AI | Paris, France

Secure your spot: register now on Luma! 🔗 luma.com/open-lakehouse

#openlakehouse #oss #opensource #deltalake #ai

At Open Lakehouse + AI Amsterdam last month, Sammy Sidhu—co-creator of the Daft multi-modal query engine and CEO of Eventual—shared how his open source journey began. 🚀

Ready to shape the future of data, open source, and AI together? Join us at our next Open Lakehouse + AI events! ⬇️

#opensource

Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…

🚀 Happening today, Sept 30 at 9AM PT!

Join us for a behind-the-scenes look at the Delta Rust Kernel with R. Tyler Croy, Robert Pack, and Scott Haines. Discover how #DeltaLake’s core is evolving with powerful new features like column mapping and deletion vectors.

👉 Register now: luma.com/delta-0930

Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…

🚨 Happening tomorrow!

Get an inside look at how the new Delta Rust kernel is transforming Delta Lake. Learn how it solves fragmentation, enables column mapping & deletion vectors, and why it matters—even if you don’t touch the kernel.

Register ➡️ luma.com/delta-0930

#opensource #deltalake #oss

Open Lakehouse + AI · Events Calendar View and subscribe to events from Open Lakehouse + AI on Luma.

Join us at our next Open Lakehouse + AI events!
🔹 Oct 7: Webinar — From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future
🔹 Nov 13: Mini Summit | Mountain View, CA
🔹 Nov 24: Open Lakehouse + AI | Paris, France

Register now on Luma! 🔗 luma.com/open-lakehouse

#ai #opensource

“Open source is giving back, because it means everyone who supports our work can participate and benefit from the software we are making." — @hannes.muehleisen.org (@duckdb.org) at Open Lakehouse + AI Amsterdam 🇳🇱

Ready to shape the future of data, open source, and AI together? ⬇️

#opensource #oss

Dropping features in #DeltaLake used to break table compatibility and history. Delta 4.0 fixes this by protecting checkpoints and rewriting recent history—keeping tables safe and stable. 💪

🎥 Watch the full webinar replay: www.youtube.com/watch?v=0BfU...

#opensource #oss

Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…

Delta Lake has evolved—fragmentation is out, the new Rust kernel is in. 🚀 Join R. Tyler Croy, Robert Pack & Scott Haines to explore fixes to past issues, new features (column mapping + deletion vectors), and why it matters.

📅 Sept 30
🕜 9AM PT
🔗 Register: luma.com/delta-0930

#DeltaLake #Rust #OSS

Scott Haines & Youssef Mrini will dive into:
🔹 Variant Type support
🔹 Type-Widening
🔹 Collated Columns
🔹 Delta Connect

Plus, they’ll revisit clustering strategies with Liquid Clustering.

See you soon! 🌟

Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…

🚨 Only a couple hours to go — Find out what's new in #DeltaLake 4.0!

🎥 LIVE on LinkedIn, X & YouTube
🗓️ Sept 16
🕑 9AM PT / 12PM ET

🔗 Register now: luma.com/delta-0923

#opensource #oss #linuxfoundation

Delta Lake Live! - YouTube

Missed the Delta Live! Rust hacking sessions with R. Tyler Croy and Robert Pack? 🤔

Catch up on the action as they dive into Rust development for Delta Lake, showcasing real-time coding, debugging, and problem-solving.

🎥 Watch here: youtube.com/playlist?lis...

#opensource #deltalake #livehacking

Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…

The countdown is on—our Delta 4.0 webinar is next week! 🚀

Join Youssef Mrini and Scott Haines as they explore the powerful new features in Delta 4.0 that can transform how you design and optimize data workflows.

🗓️ Tuesday, Sept 16
🕝 9:00AM PT
🔗 Save your spot: luma.com/delta-0923

#oss #deltalake

Upcoming Webinar ➡️ Exploring Delta’s Rust Kernel: a look behind the scenes at what powers delta-rs!

Join R. Tyler Croy, Robert Pack & Scott Haines to learn how kernel changes deliver consistency, new features & faster performance for Delta engines.

📅 Sept 30 @ 9AM PT
🔗 RSVP: luma.com/delta-0930

📣 Mark your calendar for Tuesday, October 7 at 9AM PT for the next Open Lakehouse + AI webinar: “From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future!” 🚀

🔗 Register here: luma.com/OLAI-107

#opensource #deltalake #agentic #aiagents #oss

Excited to announce Delta Live! Live Rust Hacking and AMA — streaming tomorrow, Sept 9 on Twitch. 👏

Join R. Tyler Croy and Robert Pack for a hands-on Rust session and live Q&A!

📅 Sept 9
⏰ 7AM PT / 10AM ET
🔗 twitch.tv/agentdero

Bring your questions and gain insights from #DeltaLake maintainers. 🦀

Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…

Delta 4.0 brings powerful new features that can reshape how you design and optimize your data workflows. 🚀 Join Youssef Mrini & Scott Haines as they break down their favorite features!

🗓️ Tuesday, Sept 16
🕝 9:00 AM PT
🔗 RSVP: luma.com/delta-0923

#opensource #oss #deltalake #linuxfoundation