Caleb Fahlgren

You can just ask things 🗣️

"show me messages in the coding category that are in the top 10% of reward model scores"

Download really high quality instructions from the Argilla Llama3.1 405B synthetic dataset 🔥

Most liked and most downloaded open-source AI models from 2022 to 2024

Interactive viz: aiworld.eu/embed/model/...
Discussion: huggingface.co/spaces/huggi...

It doesn't get easier than this. Why are you writing SQL by yourself when it's almost 2025

The amazing, new Qwen2.5-Coder 32B model can now write SQL for any @hf.co dataset ✨

Github Issue Generator - a Hugging Face Space by reach-vb Discover amazing ML apps made by the community

Here's the space by @reach-vb.hf.co

huggingface.co/spaces/reach...

This is insane! Structured generation in the browser with the new @hf.co SmolLM2-1.7B model

• Tiny 1.7B LLM running at 88 tokens / second ⚡
• Powered by MLC/WebLLM on WebGPU 🔥
• JSON Structured Generation entirely in the browser 🤏

Releasing SmolVLM, a small 2 billion parameters Vision+Language Model (VLM) built for on-device/in-browser inference with images/videos.

Outperforms all models at similar GPU RAM usage and tokens throughputs

Blog post: huggingface.co/blog/smolvlm

I did it via

Settings > Account > Handle > I have my own domain

and it should show there!

You can literally do the histogram in one line in less than 10 seconds 💨

> from histogram(train, "Average ⬆️")

Here's what the model licenses look like:

Lots of great open licenses in there too! 💪

The OpenLLM Leaderboard just passed 2k evals 🥳

Here's a look at the distribution of average scores for all those models!

Great work by the @huggingface.bsky.social team to do these evals!

Let us know what you think or what you want to see :)

cc: @davidberenstein.bsky.social

Let’s go!

** log and get out of the way **

using supabase theme, @tylerhillery.com would approve

Create beautiful images of your code Turn your code into beautiful images. Choose from a range of syntax colors, hide or show the background, and toggle between a dark and light window.

ray.so it's great with lots of themes!

Automatically tracking all Ollama requests to a dataset with the new observers python library!

With just a few lines of code all your requests can be sent to @huggingface.bsky.social datasets for annotating, analysis and observability 🔭

GitHub - cfahlgren1/observers: Track OpenAI compatible requests to a dataset Track OpenAI compatible requests to a dataset. Contribute to cfahlgren1/observers development by creating an account on GitHub.

Here's the library! Was fun collaborating with
@davidberenstein.bsky.social bringing the datasets and argilla all together!
github.com/cfahlgren1/o...

The main three stores are:
• DuckDB (local, SQL over traces)
• Hugging Face Datasets (dataset viewer, sql console)
• Argilla - annotation and filtering UI

observers 🔭 - automatically log all OpenAI compatible requests to a dataset 💽

• supports any OpenAI compatible endpoint 💪
• supports @duckdb.org, @huggingface.bsky.social datasets and Argilla as stores

> pip install observers

OpenCo7/UpVoteWeb · Datasets at Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science.

That’s okay, there are lots of incomplete and even snapshots. The UpVoteWeb reddit dataset is one that comes to mind.

Any data that is more accessible is a win :). My hub stats dataset is just a cron script as well haha

huggingface.co/datasets/Ope...

+1 and let me know if you need any help with it @tobilg.com would be nice to have the dataset viewer for it!

GitHub - cfahlgren1/observers: Track OpenAI compatible requests to a dataset Track OpenAI compatible requests to a dataset. Contribute to cfahlgren1/observers development by creating an account on GitHub.

We just released a library that makes it pretty seamless to send traces and LLM requests to datasets

github.com/cfahlgren1/o...

Would love to hear what you think is missing for prompts?

HuggingFaceTB/smoltalk · Datasets at Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science.

SmolTalk is out 🗣️

Over 1M high quality instructions used for training SmolLM2, one of the best small language models in the industry.

huggingface.co/datasets/Hug...

lightweight SDK for AI observability

Observers: A Lightweight SDK for AI Observability

TLDR;
- Track and record interactions with AI models
- Store observations in multiple backends @huggingface.bsky.social, @duckdb.org or Argilla
- Query and analyse your AI interactions with ease

GitHub:
github.com/cfahlgren1/o...

Foursquare Open Source Places: A new foundational dataset for the geospatial community I did not expect this! > [...] we are announcing today the general availability of a foundational open data set, Foursquare Open Source Places ("FSQ OS Places"). This base layer …

Foursquare just open sourced their 100 million place point of interest dataset! Some notes on poking around with it using DuckDB (it's Parquet files on S3) simonwillison.net/2024/Nov/20/...

Range requests + Parquet is what makes the Hugging Face SQL Console possible to query datasets entirely in the browser

duckdb-gsheets v0.0.3 is out, courtesy of @a13x.bsky.social

the power is terrifying! duckdb-gsheets.com

Amazing! I wish it worked in wasm

From Files to Chunks: Improving HF Storage Efficiency We’re on a journey to advance and democratize artificial intelligence through open source and open science.

When XetHub joined Hugging Face, we brainstormed how to share our tech with the community.

The magic? Versioning chunks, not files, giving rise to:

🧠 Smarter storage
⏩ Faster uploads
🚀 Efficient downloads

Curious? Read the blog and let us know how it could help your workflows!