Spiral

LF AI & Data Foundation Hosts Vortex Project to Power High Performance Data Access for AI and Analytics Contributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems

Vortex is incredibly exciting, we’ve already made plans months ago to make it the primary format we will be storing our data in on object storage! www.linuxfoundation.org/press/lf-ai-...

docs.rs/fsst-rs/late... in the wild 🎉

We managed to accelerate the entire TPC-H (sf=100) suite by 30%, with many of the slowest queries seeing a 2-4x speedup.

Check out the post for the inside scoop 🧊

So you want to use Object Storage Tips and lessons learned from building systems directly against object stores

"So you want to use Object Storage"

By @adamgs.bsky.social

spiraldb.com/post/so-you-...

If you're at #IcebergSummit, be sure to come see our CEO and Founder @will-manning.bsky.social
present on Turbocharging Apache Iceberg scans with Vortex!

ALP Rust is faster than C++ How well-defined casting semantics in Rust allow for 20-50% faster ALP compression

Turns out, all researchers should use rust for their reference implementations.

blog.spiraldb.com/alp-rust-is-...

Location and time are still TBD, but we're targeting a February event.

London Systems · Events Calendar View and subscribe to events from London Systems on Luma. A meetup focus on systems-oriented software engineering topics, from experts to anyone. Focused on systems like compilers, databases, browsers...

We're starting a London Systems meetup, to give a chance for (software) engineers to share and discuss their work on the underlying systems and that power most of our world - databases, compilers, VMs etc. and we're looking for speakers!
lu.ma/londonsystems

🌪️📲

It's still early days, but initial results suggest DataFusion (Vortex, partitioned) knocks ~15% off the total runtime of DataFusion (Parquet, partitioned) 🚀

We think so too 😉❤️

Greetings fellow data folks! 🦋