Tune in and listen to former #VeniceDB tech lead and all around swell guy Félix GV as he talks with Olimpiu P. on building #VeniceDB for planet scale workloads!! youtu.be/eg6EFeGSx6M?...
Latest blogpost on hashtag#VeniceDB and our journey for providing performance SLA's on data ingestion! Congrats to Gaojie Liu and the rest of the team! lnkd.in/dXn2MPUK
#VeniceDB now supports blob transfer for fast bootstrapping of instances! VeniceDB contributor Jingyan Li does a deep dive of this feature! www.youtube.com/watch?v=rosg...
Learn about Hybrid Stores, WAL, Multi-WAL, Replication and CRDTs in Venice!
youtu.be/mM-6GysXii4
It is also the realization of VIP-5 (Venice Improvement Proposal 5), which you can read more about here:
venicedb.org/docs/proposa...
This was an intern project executed by Zifeng (Leo) Li, under the mentorship of Hao Xu!
New functionality, new video! Watch it to learn about:
Facet Counting in Venice
youtu.be/gDBFBgxRqSk
"Hybrid Stores are a way to implement Lambda Architectures, but by merging at write-time, rather than read-time. They can also support Kappa Architectures."
Hybrid stores are such a "duh" pattern when you see them, but it took a long time for the industry to get here.
What is HyBRID?
HyBRID is a recursive backronym used as a mnemonic device to remember the purpose of the Hybrid Store Design Pattern. It means: Hybrid Batch/Real-time Ingested Data.
Catch the replay for the latest #VeniceDB talk!
In it, you will learn more about derived data, the related design patterns coming from the industry over the past 15 years, and how Venice's architecture keeps pushing the boundaries in that space!
youtu.be/hc0pgvnr3fQ
Check out the latest @infoq.com podcast, featuring a wide-ranging conversation between @olimpiupop.bsky.social and @felixgv.bsky.social about databases, derived data, technical migrations, performance, Venice, Java, RocksDB, @duckdb.org and more!
podcasts.apple.com/us/podcast/b...
Up to recently, Da Vinci could only materialize Venice tables into local #RocksDB files, but now it also offers the option of loading into DuckDB.
Stay tuned for more in this space!
Moreover, it supports active-active replication with #CRDT based merging and conflict resolution.
Those tables can be populated by a variety of mechanisms, including batch pushes which swap the entire table, streaming writes which insert entire rows or update individual columns, and even hybrid datasets which consists of both batch and streaming inputs.
Pumping #Kafka streams into @duckdb.org is a powerful concept!
*Duck Vinci* is a #DuckDB integration plugin for the Da Vinci Client library 🧵
The Da Vinci Client provides the ability to locally materialize Venice tables.
💡
Yes please 🎬 👏
