#dbt and #rstats friends, sorry about my past whining. I wrote up all my issues here to make your life easier, with even a tiny shoutout to #duckdb in there too!
github.com/eriksquires/...
#dbt and #rstats friends, sorry about my past whining. I wrote up all my issues here to make your life easier, with even a tiny shoutout to #duckdb in there too!
github.com/eriksquires/...
Mastering Python Modules, Packages & Namespaces From Basics to Behind the Scenes https://cstu.io/bf35ba #d #cybersecurity #oneplus
Really hate to watch online course with AI Robot Voiceover.
What is the purpose of forcing people to watch it while it canβt even taught by human???
EXCLUSIVE: Investigation proves Palestinians indiscriminately shot by Israeli military near food sites across 50 days, from yours truly for the @theguardian.com
www.theguardian.com/world/ng-int...
On March 28, a powerful M-7.7 earthquake struck Myanmar. I created this collection to compile updates from BlueSky to document that tragic event.
This feed focuses on locally relevant keywords that MM people are more likely to use.
bsky.app/profile/did:...
#MyanmarEarthquake
Diagram showing the Python 3.10+ syntactic feature that allows you to combine types with the operator pipe |. Full example source code: def is_number(x): return isinstance(x, int | float | complex) print(is_number(34)) # True print(is_number("hey")) # False
Since Python 3.10 you can use the pipe operator to combine types β this creates a type union.
This can be used, for example, when you want to check if a value belongs to one of 2+ types with `isinstance`.
Here's an example π
I've had a crazy few days with my advent calendar of code, looking at Tobiko's SQLMesh with @duckdb.org.
Yesterday, I mentioned in my post that I needed to bring in some data from @bsky.app's HTTP endpoints, and I was going to try using dltHub.
davidsj.substack.com/p/dlt-windsu...
A screenshot from my Bloom Filters blog post, showing a visualisation of the bits inside a bloom filter after the words "loved" and "your" have been added. There is also a code sample visible that reads: let bf = new CountingBloomFilter(); bf.add("loved"); bf.add("your"); bf.remove("response"); bf.contains("loved"); // false
A screenshot from my Queueing blog post. A list of goals can be seen that says: - Add 15 requests to each queue. - Add 10 priority requests to each queue. - Drop 15 requests. - Drop 10 priority requests. Below this task list can be seen a visualisation of 4 different queues.
A screenshot of my Turing Machines blog post. A Turing Machine running the first program seen in Alan Turing's 1936 paper can be seen, it prints alternative 0s and 1s to the tape.
Hi π I'm Sam, I create interactive visualisations about programming.
My posts from 2024:
- samwho.dev/bloom-filters
- encore.dev/blog/queueing
- samwho.dev/turing-machi...
I also appeared on 2 podcasts:
- hanselminutes.com/953/computer...
- www.youtube.com/watch?v=ur9c...
true story of a normal morning that changed our Myanmar peopleβs destiny. Itβs almost 4 years now.
This is one of the first that came out of thatβintegrating dbt, airflow, and superset into a single portal with permission management and multi-user context.
Disclosure: I have worked on it for a year. Try it yourself, getting started with the single docker-compose cmd.
github.com/kanton-bern/...
A virtual certificate with text "Celebrating 10M users on Bluesky, #768,719, Thet Paing βͺ@paing.bsky.socialβ¬, joined on Aug 29, 2023"
Bluesky now has over 10 million users, and I was #768,719!
New blog post ππ
A step-by-step guide to building an Apache #Airflow data pipeline that connects with #AWS services like RDS and S3.
Check it out here ππ½ www.franciscoyira.com/post/airflow...
#DataScience #DataEngineering
Do you use a makefile to manage your #dbt commands?
Mainly used for compiling code, you can actually use a makefile to run any commands
A makefile a great way to
- reduce command fatigue
- group commands
- abstract your common tasks
medium.com/inthepipelin...
#dataengineering #analytics #data
The Open Data Use Case Observatory report nicely documents examples of how and where open data is being leveraged to make an impact data.europa.eu/en/news-even...
Happy New Year!
Ukraine launches public database tracking foreign components in Russian, Iranian weaponry
War and Sanctions portal currently lists over 2000 foreign spare parts that Russia & Iran utilize in missiles, UAVs, electronic warfare systems & other military tech
This is dope: Codapi is a platform for embedding interactive code snippets directly into your product documentation, online course, or blog post. github.com/nalgeon/codapi
I love Pudding!
A story about Spotify's music taxonomy.
pudding.cool/2023/10/genre/
The testimonies of the people of Gaza. I have no more words. There is nothing more to say. We have failed the call of humanity in such a fundamental way so many times throughout history, but it is another thing entirely to have had so much access to it this time.
www.nplusonemag.com/online-only/...
Atari 2600 manual for E.T. The Extra-Terrestrial. Silver background with writing in red, with an illustrated scene with ET & Elliott.
Look, we can't make the E.T. game fun...or even playable...but we can appreciate the manual artwork from 1982, one of >3 million manuals in our collection: archive.org/details/E.T....
Four years in the making and finally released today: The Software Engineer's Guidebook is out!! Get it on Amazon or via engguidebook.com
@whereistanya.bsky.social described it like this: "This book is well named: it really does feel like the missing guidebook for the whole industry."
This #PGSQLPhriday, Chris Ellis asked about the weird and varied things that people are using #PostgreSQL for. I decided to try to explain a bit about what I'm using Postgres for in my PhD research.
Look out for all of the other #PGSQLPhriday posts!
Look Iβve been interviewed by @matty.wtf in ArrestedDevOps!
https://www.arresteddevops.com/data-data-data/
Loved talking with Matty about data, the data journey, how to make resilient data platforms and data streaming!
A good test to see if youβre writing maintainable code is to re-read it six months later.
Both pandas & tidyverse fail this test, unless I add copious comments about the shape/content/schema/types of the data frames after each transform. Comments should not replace data structures and typingβ¦
Respectfully, the War in Tigray from 2020 to ~2023 was this kind of war, with millions displaced, war crimes denied by all parties, massive disinfo campaigns, international aid blocks, and regular telecom blackouts across northern Ethiopia. I canβt begin to tell you how bleak things were and are.
Bookmark to read.
Reposting for the newbs.
This βPlayable Documentaryβ About A 1984 Classic Is One Of The Yearβs Best Games kotaku.com/making-karat...
Research finds that ChatGPT consumes 500 ml of water (about 16 oz) for every 5-50 prompts it answers.
Microsoftβs global water consumption β¬οΈ 34% from β21-β22 to 17 billion gl.
π£οΈWe are actively draining our resources for survival in the midst of climate collapse.
I will update to 3.12 after seeing your post. π