colton's Avatar

colton

@colton.boo

Data Engineering / Music / Photography / Tinkering Developer Advocate @ Dagster cmpadden.github.io

2,377
Followers
1,896
Following
91
Posts
03.08.2023
Joined
Posts Following

Latest posts by colton @colton.boo

Preview
Measuring the effectiveness of the Dagster Skills Learned how we built a light weight evaluation framework for quantiatively measuring the effectiveness of the Dagster Skills

Learn how we built a light weight evaluation framework for the official Dagster skills.

With short feedback loops and quantitative measurements, we were able to make quick improvements that improving decision routing and context management.

dagster.io/blog/evaluat...

10.02.2026 17:21 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen.

And we include the full prompt at the end of the post!

dagster.io/blog/dignifi...

09.01.2026 17:26 πŸ‘ 4 πŸ” 2 πŸ’¬ 0 πŸ“Œ 0
Post image

πŸš€ NEW on We ❀️ Open Source πŸš€

How can a small team answer 16,000+ community Qs/month?

Colton Padden (@colton.boo) reveals Dagster’s smart AI-powered doc strategyβ€”built for humans and LLMs.

allthingsopen.org/articles/sca...

#WeLoveOpenSource #OpenSource #AI #TechDocs #Dagster #CommunitySupport

16.12.2025 20:38 πŸ‘ 3 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0
Preview
Scaling documentation without scaling your team: Dagster's AI-powered strategy | We Love Open Source β€’ All Things Open Learn how Dagster's small team scaled community education by restructuring docs around the software development lifecycle, using AI tools, and building a custom assistant that answers over 16,000 ques...

allthingsopen.org/articles/sca...

16.12.2025 17:18 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog!

16.12.2025 17:18 πŸ‘ 5 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0

So excited for this to be available! πŸš€

07.11.2025 04:15 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
How to Scale Data Teams | Free eBook from Dagster Download Dagster's free eBook to learn how to build systems that scale with clarity, reliability, and confidence.

β€œFlexibility without fragmentation”

In addition to some solid alteration, it’s also a great explanation of how to build a data team and how your system can and should scale.

@colton.boo and Dennis Hume have an awesome new ebook on this topic, check it out!

#dataBS

dagster.io/how-to-scale...

07.11.2025 02:39 πŸ‘ 4 πŸ” 1 πŸ’¬ 1 πŸ“Œ 1
Preview
Enabling Community Education With a Little Help From AI β€’ All Things Open 2025 Dagster is a sophisticated tool and platform for building data pipelines, and community members heavily rely on our documentation and educational content to make use of all of its features. In this se...

2025.allthingsopen.org/sessions/ena... #AllThingsOpen

12.10.2025 21:44 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Excited to be at All Things Open tomorrow!

Come hang out at the @dagster.io booth, or see my talk β€œEnabling education with a little help from AI” at 1:45 EST on Tuesday!

12.10.2025 21:43 πŸ‘ 5 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0

@ssp.sh this might be relevant to your interests!

08.08.2025 14:11 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Read this post you work in data analytics.

A similar mindset problem pervades sales engineering as well, especially in the demo / early stages of discovery.

Understand your prospect’s context. Who are they? What do they care about? What value can you provide them? That’s what you show.

28.07.2025 01:39 πŸ‘ 11 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0
Preview
DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes MΓΌhleisen YouTube video by MotherDuck

MotherDuck is live now!

DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes MΓΌhleisen

www.youtube.com/live/yn07s-_...

17.06.2025 15:03 πŸ‘ 5 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Agreed, what a great watch / listen!

04.06.2025 15:40 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Thanks @christiannolan.bsky.social!

25.05.2025 05:08 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Oxidise Your Command Line (2025 Edition)
Oxidise Your Command Line (2025 Edition) YouTube video by No Boilerplate

New Oxidise Your Command Line just dropped.

Some that stand out to me are: xh, fselect, and presenterm!

www.youtube.com/watch?v=rWMQ...

23.05.2025 03:28 πŸ‘ 5 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

mpv might just be the best way to watch twitch.tv.

mpv.io

22.05.2025 03:14 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

@pycon.us might just be my favorite conference ever. everyone is so nice!

17.05.2025 16:02 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Whoa, that's neat! πŸ“·

05.05.2025 14:32 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Open Table Format Evolution

Open Table Format Evolution

I'm writing about #opentableformats. With the newest entries of AWS S3 tables and Cloudflare R2, it's interesting to reassess the market and see where the future with managed Iceberg Tables leads us.

What's your take? And anything missing on the evolution below?

02.05.2025 12:28 πŸ‘ 5 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0

It’s surprisingly easy using FastMCP:

github.com/jlowin/fastmcp

We’ll likely refactor this code not to use subprocess, but you can see our initial implementation here!

github.com/dagster-io/d...

21.04.2025 12:55 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
GitHub - cmpadden/llm.nvim: Chatblade integration for Neovim Chatblade integration for Neovim. Contribute to cmpadden/llm.nvim development by creating an account on GitHub.

github.com/cmpadden/llm...

09.04.2025 02:30 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Screenshot of the https://github.com/cmpadden/llm.nvim repository README.

Screenshot of the https://github.com/cmpadden/llm.nvim repository README.

Refactored `chatblade.nvim` to use `llm`, and renamed the project to `llm.nvim`. It's archaic compared these agentic MCP workflows, but it's completely replaced Googling programming related questions.

09.04.2025 02:29 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

The dream! Best of luck.

03.04.2025 15:08 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

I sat down to chat with Chris about "Project Airlift", a way to easily observe Airflow environments directly from Dagster.

With a couple of lines of code, you can get a holistic picture into all of your environments, and then optionally migrate them!

03.04.2025 14:35 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

🚨 New Course Alert 🚨

We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University.

dagster.io/blog/dagster...

01.04.2025 18:00 πŸ‘ 6 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0
REST API source | dlt Docs Learn how to set up and configure

dlthub.com/docs/dlt-eco...

21.03.2025 15:43 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Screenshot of the DuckDB's local UI and a code example using dltHub's REST source config.

Screenshot of the DuckDB's local UI and a code example using dltHub's REST source config.

Tinkering with dltHub's REST API source to ingest data without having to write any bespoke code, and DuckDB's new local web UI, and I feel so spoiled with how good data tooling is getting!

21.03.2025 15:43 πŸ‘ 7 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸš€ Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"?

You can find a link to demo videos and a GitHub discussion in the thread!

13.03.2025 21:19 πŸ‘ 11 πŸ” 3 πŸ’¬ 1 πŸ“Œ 0

Ha, I don't know if I'd recommend my extension to people, it's not very polished. But it's cool that you tried it!

My usage of it is often writing a comment with a prompt, selecting it and typing `:Chatblade` or making a selection with additional prompting like `:Chatblade convert these to...`.

26.02.2025 14:45 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Very nice! Glad to see you had a good experience with it too.

26.02.2025 14:23 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0