Sean Lopp's Avatar

Sean Lopp

@loppsean

Dagster, RStudio, Looker. Dad. Bikes. Coffee.

592
Followers
322
Following
70
Posts
11.11.2024
Joined
Posts Following

Latest posts by Sean Lopp @loppsean

Are people calling the Nvidia cosmos paper the next "attention is all you need" but for physical AI systems?

08.01.2025 18:57 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

A few years ago @vickiboykis.com posted a sample of post modern jukebox in this category.

In tech this year, one example was the first time I used @crmarsh.com `uv pip install`

I'm curious if folks have others?

But anyway, this vid from a few years ago is my recent go-to example

20.12.2024 22:53 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Chance the Rapper Performs a Country Version of Nelly’s β€œHot in Herre” | That’s My Jam
Chance the Rapper Performs a Country Version of Nelly’s β€œHot in Herre” | That’s My Jam YouTube video by The Tonight Show Starring Jimmy Fallon

tldr www.youtube.com/watch?v=TRCJ...

End of year we tend to reflect on "Best of...". I've been thinking of _craft excellence_, eg cases where someone produces a masterpiece, an example of them just being excellent at their craft.

20.12.2024 22:53 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
30 Days of Orchestration - Day 18
30 Days of Orchestration - Day 18 YouTube video by Sean Lopp @ Dagster Labs

Day 18, happy holidays friends! youtu.be/GjndggmuhCs

20.12.2024 15:39 πŸ‘ 4 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0
30 Days of Orchestration - Day 17
30 Days of Orchestration - Day 17 YouTube video by Sean Lopp @ Dagster Labs

Day 17! Today's challenge is about conditional branching in data pipelines

youtu.be/MgkniMnmhMU

19.12.2024 17:35 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 16
30 Days of Orchestration - Day 16 YouTube video by Sean Lopp @ Dagster Labs

Day 16! youtu.be/mrlFdKJlosY

(sorry for no video on day 15... life ya know)

18.12.2024 23:08 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

I see what you did there, and I am not honoring it with a heart reaction.

17.12.2024 02:24 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

what makes me happy is thinking someone at HPE had to have a convo with AWS and SAP, where SAP argued it'd be easier to build a machine with >1000 CPU and 32TB of RAM than figure out how to run SAP on more than one node

17.12.2024 02:23 πŸ‘ 6 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
30 Days of Orchestration - Day 14
30 Days of Orchestration - Day 14 YouTube video by Sean Lopp @ Dagster Labs

Day 14 and mayyybbbbee my favorite day so far. Dynamic code gen and peeling back the onion on ways to combine different Python parallelization "layers" .... what more could you want for a Monday? youtu.be/azfCDBKTIoQ

16.12.2024 18:39 πŸ‘ 5 πŸ” 2 πŸ’¬ 1 πŸ“Œ 1
30 Days of Orchestration - Day 13
30 Days of Orchestration - Day 13 YouTube video by Sean Lopp @ Dagster Labs

Lucky Day 13 - all about incremental data processing

youtu.be/_WSOaE5mr4g

13.12.2024 17:57 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1

@loppsean.bsky.social's walk through of asset checks in Day 11 is awesome, do check it out!

In some cases, you might not want to re-read in the asset data (or you might even want to compare across previous materializations!)

In my example, I use Dagster's metadata system to do just that.

11.12.2024 22:22 πŸ‘ 6 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0
30 Days of Orchestration - Day 11
30 Days of Orchestration - Day 11 YouTube video by Sean Lopp @ Dagster Labs

Day 11! The diff between orchestration and data orchestration? Your code can stay the same, still work, but the data can change and break everything! youtu.be/ugS1KQhxWrA

11.12.2024 16:46 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1

For day 10 of 30 days of orchestration, one of my fave topics: materializing assets in different environments using resources!

In my solution to day 10, I added an environment variable, DAGSTER_PROD_DEPLOY, which determines whether to use the folder `data_prod` or `data_dev` if it is not present.

10.12.2024 21:23 πŸ‘ 2 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0
30 Days of Orchestration - Day10
30 Days of Orchestration - Day10 YouTube video by Sean Lopp @ Dagster Labs

Day 10! Data engineers + Pydantic classes = goodness. youtu.be/f_XfLTlHS-s

10.12.2024 17:30 πŸ‘ 8 πŸ” 2 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 9
30 Days of Orchestration - Day 9 YouTube video by Sean Lopp @ Dagster Labs

Day 9! youtu.be/g4oABNiIOmw

09.12.2024 17:01 πŸ‘ 3 πŸ” 1 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 8
30 Days of Orchestration - Day 8 YouTube video by Sean Lopp @ Dagster Labs

Daty 8, happy Friday! youtu.be/iroAyNM0kxA

06.12.2024 22:01 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
30 Days of Orchestration - Day 7
30 Days of Orchestration - Day 7 YouTube video by Sean Lopp @ Dagster Labs

Day 7! youtu.be/u9V0As2RZ5k

05.12.2024 16:46 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 6
30 Days of Orchestration - Day 6 YouTube video by Sean Lopp @ Dagster Labs

Day 6! youtu.be/RSUk6DU531w

04.12.2024 16:30 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 5
30 Days of Orchestration - Day 5 YouTube video by Sean Lopp @ Dagster Labs

Day 5! youtu.be/jNCaAYA-MVU

03.12.2024 16:03 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1
30 Days of Orchestration - Day 4
30 Days of Orchestration - Day 4 YouTube video by Sean Lopp @ Dagster Labs

Day 4! (Its not too late to catch up!) youtu.be/Jaann2QiGwQ

02.12.2024 16:57 πŸ‘ 4 πŸ” 1 πŸ’¬ 0 πŸ“Œ 1

but did you like santa or rudolph daggie?

27.11.2024 21:43 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
30 Days of Orchestration - Day 3
30 Days of Orchestration - Day 3 YouTube video by Sean Lopp @ Dagster Labs

Day 3! youtu.be/xUJTal1cq0Y

Learn about more complex DAG scheduling, and get a sneak peek of holiday Daggie

27.11.2024 18:19 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1

Probably not? I think there are generally 3 viable options:

- deploy to Dagster+ serverless: great for individuals playing around who want to run their hobby project
- deploy OSS Dagster: this quickly becomes a "choose your own adventure"
- deploy Dagster+ as a team in prod

27.11.2024 17:12 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Here is my solution: github.com/cnolanminich...

For this one, I wanted to play with the new `target` argument 🀩

For the super common scenario of having one job per schedule, add a "target" argument and select the assets you want -- in my case "asset_one" and everything downstream

#dataBS

26.11.2024 21:14 πŸ‘ 4 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

ffs @msft365.bsky.social . ffs.

26.11.2024 19:56 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

For the benefit of customers that are familiar with Power BI, the table also includes Power BI Premium per capacity P SKUs and v-cores. Power BI Premium P SKUs support Microsoft Fabric. A and EM SKUs only support Power BI items.

26.11.2024 19:56 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

The capacity and SKUs table lists the Microsoft Fabric SKUs. Capacity Units (CU) are used to measure the compute power available for each SKU.

26.11.2024 19:56 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Capacities are split into Stock Keeping Units (SKUs). Each SKU provides a set of Fabric resources for your organization. Your organization can have as many capacities as needed.

26.11.2024 19:56 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Me trying to figure out Power BI pricing

To share content and collaborate in Microsoft Fabric, your organization needs to have an F or P capacity, and at least one per-user license.

26.11.2024 19:56 πŸ‘ 1 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0
30 Days of Orchestration - Day 2
30 Days of Orchestration - Day 2 YouTube video by Sean Lopp @ Dagster Labs

Day 2! Its a holiday week, lets talk how you accommodate business schedules with cron

youtu.be/Wja1EmyIexE

26.11.2024 17:06 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 1