Will Manning

LF AI & Data Foundation Hosts Vortex Project to Power High Performance Data Access for AI and Analytics Contributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems

Vortex is incredibly exciting, we’ve already made plans months ago to make it the primary format we will be storing our data in on object storage! www.linuxfoundation.org/press/lf-ai-...

Genuinely cool work by @a10y.dev showing that Vortex provides a huge speed-up as a drop-in replacement for Parquet in Spark+Iceberg workloads.

So you want to use Object Storage Tips and lessons learned from building systems directly against object stores

"So you want to use Object Storage"

By @adamgs.bsky.social

spiraldb.com/post/so-you-...