Ned Letcher's Avatar

Ned Letcher

@ned.sh

Data science, AI/ML, analytics, visualisation. Naarm/Melbourne @thoughtworks, #dataBS, #Python, #NLP, #DuckDB, & assorted whimsical miscellania

3,559
Followers
9,942
Following
134
Posts
22.06.2023
Joined
Posts Following

Latest posts by Ned Letcher @ned.sh

Specialist Tracks β€” PyCon AU 2026

Hey #python, #data and AI peeps! #pyconau 2026 is in Brisbane this year and the CFP is open!

Are you a (wrangler | engineer | curator | researcher) doing things with data or AI/ML? Consider sharing with the community--submit to the Data and AI specialist track!

2026.pycon.org.au/cfp/speciali...

13.02.2026 01:10 πŸ‘ 5 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

I'm headed to San Diego this afternoon to attend the mech interp workshop at #NeurIPS! Really excited to give a lightning talk and catch up with everyone. 🌴

06.12.2025 17:56 πŸ‘ 4 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

San Diego!

04.12.2025 02:25 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
A selfie of me looking quizzically excited, in the poster hall of NeurIPS 2025, standing under the Deep Learning section sign hanging from the roof

A selfie of me looking quizzically excited, in the poster hall of NeurIPS 2025, standing under the Deep Learning section sign hanging from the roof

I'm in town for NeurlPS all week. Wow this conference is biiiig. Anyone I know (or don't know!) up for a drink?

#NeurIPS #NeurIPS2025 #mlsky

03.12.2025 20:27 πŸ‘ 5 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0
A map of all the different names for woodlice in the United Kingdom

A map of all the different names for woodlice in the United Kingdom

I like to think that this map of all the regional names for woodlice in the UK could also be a map illustrating the new tribes of humans to be found on the same landmass after The Great Digital Crash and ensuing breakdown of society.

25.10.2025 09:00 πŸ‘ 707 πŸ” 217 πŸ’¬ 98 πŸ“Œ 96
Preview
Data Behind the Scenes 2025 - YouTube Data Behind the Scenes is a data conference by data practitioners, for data practitioners. We come together to share stories and experiences about the the me...

The videos from the #DataBS Conference have made it to YouTube!

Over the coming days, we'll highlight sessisons from the event -- one post per talk.

You can also sneak ahead by going straight to the YouTube playlist, here:

www.youtube.com/playlist?lis...

06.10.2025 17:15 πŸ‘ 24 πŸ” 12 πŸ’¬ 1 πŸ“Œ 0
Preview
Data Cleaning IS Analysis, Not Grunt Work Also, most data cleaning articles suck

I got introduced to @randyau.com's 'Data Cleaning IS Analysis, Not Grunt Work' post during the #dataBS Conf this week: www.counting-stuff.com/data-cleanin... . I just finished--it was a great read.

Here are some quotes and thoughts I'm walking away with πŸ‘‡

1/9 #RStats

28.09.2025 04:59 πŸ‘ 47 πŸ” 11 πŸ’¬ 3 πŸ“Œ 0
Preview
β€˜Such Flexible Intensity of Life’ | Verlyn Klinkenborg Their striking intelligence makes octopuses tempting subjects for wishful anthropomorphism and uncanny reminders of nature’s mysteries.

β€œIn humans, curiosity usually begins as a mental stirring, but in octopuses,… it’s a function of bodily design. In a sense, curiosity + intention are dispersed throughout an octopus’s tissuesβ€”right out to the tips of its tentacles. Inquisitiveness… β€˜is built into the octopuses’ anatomy.’”

22.09.2025 05:01 πŸ‘ 128 πŸ” 30 πŸ’¬ 5 πŸ“Œ 3
Preview
Chartle - A daily chart game Guess the country in red by analysing today's chart

Launch day πŸš€

We’ve just released @chartlecc.bsky.social - a daily chart game!

Your job is to guess which country is represented by the red line in today's chart. You get 5 tries, no other clues!

Play today, come back tomorrow for a different chart with new data and share with your chart friends πŸ“ˆ

12.09.2025 13:41 πŸ‘ 125 πŸ” 53 πŸ’¬ 12 πŸ“Œ 28

It's been a week since we launched @chartle.cc with @adnaanj.bsky.social and we had an amazing start!

- Average of 700 users/day
- Record 1.2K users yesterday
- From 78 countries
- 66% win overall
- 2m 18s average engagement

Thank you to all who played + shared the game
Any feedback, send our way!

19.09.2025 12:32 πŸ‘ 21 πŸ” 10 πŸ’¬ 5 πŸ“Œ 1
Post image

πŸ“ˆ DuckDB 1.4.0 is out! This is our first LTS release which comes with *one year of community support*. It also supports database encryption, the MERGE SQL statement and Iceberg writes.

For more details, read the announcement blog post at
duckdb.org/2025/09/16/a...

16.09.2025 11:55 πŸ‘ 52 πŸ” 22 πŸ’¬ 0 πŸ“Œ 3
Video thumbnail

Behold my latest keyboard, the JuggleKeyboard!

Just click the letters as they're juggled, it's an easy* way to type.

* it's not easy

15.09.2025 00:43 πŸ‘ 1323 πŸ” 442 πŸ’¬ 35 πŸ“Œ 26
Preview
Flowers of the Sky Depictions spanning almost a whole millennium β€” in chronological order β€” of comets, meteors, meteorites and shooting stars.

Does anyone want beautiful historical depictions of celestial phenomena? Anyone? Well, here you go publicdomainreview.org/collection/f...

15.09.2025 09:36 πŸ‘ 106 πŸ” 37 πŸ’¬ 3 πŸ“Œ 1
β€œAI chat" icon collage from the Mac App Store

β€œAI chat" icon collage from the Mac App Store

"AI" is going great!

blog.jim-nielsen.com/2025/mac-app...

15.09.2025 10:06 πŸ‘ 6 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0
Preview
AI Evals For Engineers & PMs by Hamel Husain and Shreya Shankar on Maven Learn proven approaches for quickly improving AI applications. Build AI that works better than the competition, regardless of the use-case.

I'd recommend this course for anyone working on operational systems where LLM output may play a load-bearing role, even if you're not of the engineering persuasion, but are up for getting your hands dirty with some code.

maven.com/parlance-lab...

02.09.2025 04:00 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

The course validated my intuitions that these foundations apply just as much to generative AI applications and has given me a road-tested pragmatic framework for applying them to the weird world of LLMs and AI engineering.

02.09.2025 04:00 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Their approach thoroughly resonates with my experience as a data scientist: look at your data, perform thorough error analysis, develop metrics that matter, and iterate via experimentation and user-feedback.

02.09.2025 04:00 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

I recently completed @hamel.bsky.social and @sh-reya.bsky.social's AI Evals For Engineers & PMs, which presented practical frameworks for identifying appropriate dimensions of quality, creating automatic validators to measure at scale, and effective feedback loops that enable continual improvement

02.09.2025 04:00 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Assessing LLM output quality requires managing their vast input/output spaces and acute sensitivity to minor prompt changes, but many teams are still running on largely vibe-based evals, incurring considerable risk and preventing systematic product improvement.

We can do better! #databs #mlsky

02.09.2025 04:00 πŸ‘ 3 πŸ” 1 πŸ’¬ 1 πŸ“Œ 1
Preview
If AI and workers were strong complements, what would we see? The answer is pretty much what the initial data is showing

If AI and workers were strong complements, what would we see?, by @joshgans open.substack.com/pub/joshuaga... Does the latest data tell us AI is a substitute for human work? Nope. Is that comforting? Also nope. My comments on @erikbryn and co. (and @Noahpinion

30.08.2025 20:04 πŸ‘ 18 πŸ” 10 πŸ’¬ 1 πŸ“Œ 2
Post image

debugging new pretrain like

30.08.2025 08:08 πŸ‘ 10 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

There is a reason why the introduction and first three chapters are required reading in weeks two and three of my law and technology course

Essential for understanding where we are

28.08.2025 22:56 πŸ‘ 73 πŸ” 19 πŸ’¬ 1 πŸ“Œ 0
Post image

DuckDB is awesome and it’s a great tool to explore and transform data. But DuckDB doesn’t help you visualize and share data with others. That's why I built Shaper:

taleshape.com/blog/turn-yo...

#duckdb #databs #dataengineering

26.08.2025 09:23 πŸ‘ 11 πŸ” 4 πŸ’¬ 0 πŸ“Œ 0
Preview
DataBS Conf "Data, Behind the Scenes" is a free-to-attendΒ online-only, single trackΒ conference centered on the real stories of data work from the folks in the trenches. We’re not here for the latest AI hype, perf...

Data Behind the Scenes Conference free registration is open! Wed Sept 24, ~10am-5pm EDT. Online-only, single track.

Join data folks as they share experiences with how data work is done in production, thorns & disturbing hacks and all!
(Pls help get the word out πŸ“ˆ)

ti.to/databsconf/d...

#dataBS

20.08.2025 17:16 πŸ‘ 22 πŸ” 11 πŸ’¬ 2 πŸ“Œ 1
Preview
DataBS Conf "Data, Behind the Scenes" is a free-to-attendΒ online-only, single trackΒ conference centered on the real stories of data work from the folks in the trenches. We’re not here for the latest AI hype, perf...

I got my #DataBS Conf ticket todayyy! Come hangout with us!

ti.to/databsconf/d...

21.08.2025 20:13 πŸ‘ 20 πŸ” 1 πŸ’¬ 0 πŸ“Œ 2

Is there any book for working professionals that teaches them how to dissect, compress, and traverse a domain quickly to come up with first principles of any domain?

To rapidly map any domain's knowledge structure in weeks, not years

11.08.2025 11:33 πŸ‘ 3 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0

Mythical agent month

10.08.2025 01:42 πŸ‘ 25 πŸ” 7 πŸ’¬ 2 πŸ“Œ 0
Screenshot of embedding atlas showing the embedding view on the left, a table at the bottom and charts on the right.

Screenshot of embedding atlas showing the embedding view on the left, a table at the bottom and charts on the right.

πŸš€ We've just open-sourced Embedding Atlas – a tool for exploring large embedding spaces through rich, interactive visualizations πŸ“Š.

01.08.2025 08:24 πŸ‘ 117 πŸ” 33 πŸ’¬ 4 πŸ“Œ 4
Post image Post image Post image Post image

I’ve been working on an experimental, multiplayer, open-world AI chat system called Numinex.

1. Uses branching comment trees
2. Multiplayer/multimodel
3. Explicit context curation
4. Built on ATProto
5. Open observation of model behaviors

09.07.2025 00:02 πŸ‘ 101 πŸ” 13 πŸ’¬ 2 πŸ“Œ 8