That's awesome ๐
That's awesome ๐
Why can't you test against the current schedule vs a delayed schedule?
Who's your favorite philosopher?๐
Sorry to be 10 year late on the discussion
I'm reading there's controversy on putting satellites on links in data vault. Curious if #databs has any opinions on the matter.
Thanks Shane
Looking for data vault 2.0 training recommendations. Gotta be pre-recorded or remote. #databs
Never give up, never surrender ๐ช
Bet that baby could possibly handle my 25 left joins I write.
Paradime has AI tools for dbt. I haven't used them, sorry.
Although one of the best, probably also the most boring exercise machine ever produced by Man
I think I'm your target demographic Timo. Our team is trying to put sunset clauses on new adhoc pipelines and dashboards so at least we don't support things indefinitely.
Honestly I think accumulating snapshots are underutilized. #databs
Thanks for the reply Shane. But that's where I disagree with the author. I feel like I the data warehouse we can apply transformations for analytical purposes only. If there are 200 transaction codes and we put them in 5 buckets that aren't represented in the application layer, what's wrong with it?
Not sure I understand this article. I wish the author gave examples of antipaterns of Data Engineers building business Logic in the data warehouse. I assumed unless if your doing reverse ETL the application layer needs to maintain their own business Logic. towardsdatascience.com/data-enginee...
Yeah I enjoyed his book. He uses some patterns from data vault without the complexity of full blown data vault.
I've been influenced by Roberto Zagni's pragmatic data platform approach. I like the patterns he uses. youtu.be/OYrbg5q-CHo?...
sadly I have to agree with you Matt. Not sure why Inmon is framing Kimball's approach as just data marts.
Chapter 2 of Adamson's Star Schema covers this well. Both authors are pragmatic and allowed flexibility in their approaches. Lots of misconceptions in this space.
Nobody doing data contracts lol
I really am falling in love with array_agg(). I'm scared to think that my end game is me flattening and reconstructing json objects. #databs
Reading this now. #databs
Agreed Joe. More so than reading books (which I highly recommend). I think we need repetitive practice in our industry. I take inspiration from web developers who can build simple websites over a weekend. Many data professionals are not getting their reps in. My $.02.
Ultimately, I provide dopamine to executives. They like seeing numbers on a screen.
Finished these two. Really enjoyed Star Schema. Data Modeling Storytelling has some good advice too #bsdata
I'm interested. I work in finance reporting. We take scd2 and date explode them and build periodic snapshot tables. Curious how others deal with them.
Really like it's ability to be a "glue" database. Read directly from postgres, s3, parquet, csv , json, pandas dataframes, http urls. As a data engineer I like to sample data before building automated pipelines.
Big fan or buying discarded corporate laptops, install SSD drive, and installing Ubuntu or Fedora. Give old tech new life.
In data warehousing, edit, publish, but don't manufacture. #databs
Thanks for uploading so much material. Learning a ton. @eczachly.bsky.social