Was doing a monthly pull of numbers earlier today and found out the people who owned the source data were all laid off in early Feb.
03.03.2026 02:59
👍 0
🔁 1
💬 0
📌 0
Was doing a monthly pull of numbers earlier today and found out the people who owned the source data were all laid off in early Feb.
Outlook's UI is god awful these days
Now to do the stuff I'm very familiar with. Documenting the tables, mapping how they fit together, and making scrappy v1 dashboards.
Full schema rewrite and full data refresh every day. That'll probably be a mistake at some point. At the very least Ill have to change it when incremental loads/upserts are needed.
I don't manually wanna write the create statements for each of these Salesforce objects. i wrote a function to look at the pandas data types, examine the properties of the data, and choose a redshift data type and byte size that's valid.
Data is pulled into panda and cleaned thoroughly. Pandas is funky when converting data types to parquet and redshift hates how they translate to each other, it seems.
Used simple_salesforce's bulk API to pull the data. Our team is still pretty small so full refreshes daily have us well below our api limits. The bulk api doesn't allow select * style queries so I first have to obtain all queryable columns then dynamically generate the select statement.
Salesforce data finally in Redshift! For a first data engineering project I think it went pretty well.
I absolutely love this gay couple on Neighbors ep 2
It's so embarrassing for a journalist to reach the point in their career to be able to ask direct questions to the president and you use that opportunity to stroke his ego.
Just realized what getattr is in python. All this time I've been coding around it.
Can't have the dogs out at the desk!
Metrics become intertwined with company culture. Surveillance changes behavior and the way we relate to one another. Everyone is trying to get the number up and pressure is applied to get it there.
I'm a decent analyst. I've been around data enough to know that it doesn't speak for itself. It is created and shaped into something that allows us to read meaning in it. This translation effort has to be done with some mathematical rigor, historical understanding, and a healthy dose of empathy.
I've been reflecting a lot on how the data team is responsible for shaping the narrative around what is going right and wrong and what the path is forward.
My org is undergoing very public layoffs with "following the data" given as a justification at every turn. As someone working in data at the org, it's laughable.
Yeah, his people are just bad at their jobs
I think he did new value minus old value divided by new value. (199-1300)/199 =-579%. It's the percentage change formula but it should be divided by old value instead (-85%).
Amid the hundreds of colleagues we’ve lost today, I wanted to highlight the BRILLIANT data/graphics folks who any newsroom should be fighting to hire right now—threading here:
My partner's mom has socks that she controls the temperature by app, I know some freak analyst knows how hot people like their feet
Seeing Hamnet at a Regal theater. Before the movie there were three ads for concessions that were just people eating popcorn, and drinking their soda. I would love to see the analytics that shows that this effectively drives up the sales of mid movie snacks and drinks.
This week on Counting Stuff, my brain is overloaded doing new-work-onboarding and so the only bandwidth I had was writing tips on onboarding to data work to at least make it less chaotic. slightly. #dataBS
www.counting-stuff.com/effective-tr...
Found out I sleep very well to white noise but so upset that my top song this year is going to be "Clean Baby Sleep White Noise (loopable)"
Instant DePalma fan after seeing Blow Out. Dude knows how to make a great movie. Saving my first Body Double watch for a good rainy day.
Happy annual review time for all that celebrate. I pray for your self-loathing to step aside and for you to see that your work is valuable and should be compensated.
Cypress Grove Cheese
Cheese review: Cypress Grove's Midnight Moon. I've had maybe 7 different cheeses in my life. First bite was like a 2/5 and had me questioning if goat cheese was my thing. It got better as I ate it. Whole foods brown butter cookie helped the process. 3.5/5. #Chedderboxd 🧀
In a side by side pizza roll matchup, pepperoni has defeated combination
Built a web crawler to verify that each page on my site has the data layer set up so that gtm captures events correctly
That and Opera are soo good. Love Argento's soundtracks
Letterboxd feature request: ability to follow cast or crew to get notified when they have a newly released film