Andy Nelson's Avatar

Andy Nelson

@andynelson817

Data Engineer living in Texas

24
Followers
30
Following
30
Posts
26.11.2024
Joined
Posts Following

Latest posts by Andy Nelson @andynelson817

That's awesome ๐Ÿ˜Ž

09.06.2025 01:05 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Why can't you test against the current schedule vs a delayed schedule?

20.02.2025 02:36 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Who's your favorite philosopher?๐Ÿ˜‚

20.02.2025 02:33 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Sorry to be 10 year late on the discussion

23.12.2024 19:51 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

I'm reading there's controversy on putting satellites on links in data vault. Curious if #databs has any opinions on the matter.

23.12.2024 19:51 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 3 ๐Ÿ“Œ 0

Thanks Shane

17.12.2024 02:53 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Looking for data vault 2.0 training recommendations. Gotta be pre-recorded or remote. #databs

16.12.2024 15:44 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Never give up, never surrender ๐Ÿ’ช

13.12.2024 16:31 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Bet that baby could possibly handle my 25 left joins I write.

13.12.2024 13:40 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Paradime has AI tools for dbt. I haven't used them, sorry.

12.12.2024 03:38 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Although one of the best, probably also the most boring exercise machine ever produced by Man

11.12.2024 16:47 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

I think I'm your target demographic Timo. Our team is trying to put sunset clauses on new adhoc pipelines and dashboards so at least we don't support things indefinitely.

11.12.2024 13:55 ๐Ÿ‘ 2 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Honestly I think accumulating snapshots are underutilized. #databs

11.12.2024 13:44 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Thanks for the reply Shane. But that's where I disagree with the author. I feel like I the data warehouse we can apply transformations for analytical purposes only. If there are 200 transaction codes and we put them in 5 buckets that aren't represented in the application layer, what's wrong with it?

11.12.2024 03:42 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Data Engineering, Redefined How data engineering is practiced today and why we should redefine it

Not sure I understand this article. I wish the author gave examples of antipaterns of Data Engineers building business Logic in the data warehouse. I assumed unless if your doing reverse ETL the application layer needs to maintain their own business Logic. towardsdatascience.com/data-enginee...

09.12.2024 19:38 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Yeah I enjoyed his book. He uses some patterns from data vault without the complexity of full blown data vault.

07.12.2024 14:53 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

I've been influenced by Roberto Zagni's pragmatic data platform approach. I like the patterns he uses. youtu.be/OYrbg5q-CHo?...

06.12.2024 23:32 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

sadly I have to agree with you Matt. Not sure why Inmon is framing Kimball's approach as just data marts.

06.12.2024 23:20 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Chapter 2 of Adamson's Star Schema covers this well. Both authors are pragmatic and allowed flexibility in their approaches. Lots of misconceptions in this space.

06.12.2024 14:57 ๐Ÿ‘ 2 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Nobody doing data contracts lol

02.12.2024 21:13 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

I really am falling in love with array_agg(). I'm scared to think that my end game is me flattening and reconstructing json objects. #databs

02.12.2024 20:38 ๐Ÿ‘ 7 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Reading this now. #databs

01.12.2024 02:20 ๐Ÿ‘ 4 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Agreed Joe. More so than reading books (which I highly recommend). I think we need repetitive practice in our industry. I take inspiration from web developers who can build simple websites over a weekend. Many data professionals are not getting their reps in. My $.02.

01.12.2024 02:13 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Ultimately, I provide dopamine to executives. They like seeing numbers on a screen.

01.12.2024 01:59 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Finished these two. Really enjoyed Star Schema. Data Modeling Storytelling has some good advice too #bsdata

01.12.2024 00:55 ๐Ÿ‘ 2 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

I'm interested. I work in finance reporting. We take scd2 and date explode them and build periodic snapshot tables. Curious how others deal with them.

30.11.2024 03:45 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Really like it's ability to be a "glue" database. Read directly from postgres, s3, parquet, csv , json, pandas dataframes, http urls. As a data engineer I like to sample data before building automated pipelines.

30.11.2024 03:30 ๐Ÿ‘ 6 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Big fan or buying discarded corporate laptops, install SSD drive, and installing Ubuntu or Fedora. Give old tech new life.

29.11.2024 15:53 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

In data warehousing, edit, publish, but don't manufacture. #databs

29.11.2024 15:50 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Thanks for uploading so much material. Learning a ton. @eczachly.bsky.social

27.11.2024 02:49 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0