Suraj Deshmukh | सुरज देशमुख

Github has a recommendation on doing dotfiles:
dotfiles.github.io

Setting Up OpenClaw with Azure AI Foundry Learn how to configure OpenClaw to use Azure AI Foundry models, giving you a self-hosted AI assistant accessible from Telegram and other chat apps.

I just published a new guide on configuring #OpenClaw 🦀 to run with #Azure AI Foundry models. You control data control, so more privacy, talk to it from #Telegram or using the console!

Check it out here: suraj.io/post/2026/op...

Running Linux Containers Natively on macOS with Apple's Container CLI Learn how to use Apple's container CLI tool to run Linux containers as lightweight VMs on macOS with sub-second startup times

Apple has a new native container CLI for macOS! Run Linux containers without Docker Desktop—with sub-second startup times. 🚀

My guide covers setup, resource limits, and fixing macOS firewall blocks:
🔗 suraj.io/post/2026/us...

#macOS #Containers

Try it:

/goodreads tell me about project hail mary by andy weir
/goodreads add the midnight library to my want to read shelf

Install with one command:
clawhub install goodreads

🔗 clawhub.ai/surajssd/goodreads
🐙 github.com/surajssd/openclaw-goodreads-skill

2/n: Since Goodreads deprecated their API in 2020, this skill uses browser automation under the hood. No API keys (but you'd need to login once) — just the browser tool doing what you'd do manually!

1/n 📚 Made something for fellow book nerds using Openclaw:

A Goodreads skill that lets your AI agent search for books, pull up details & reviews, get personalized recommendations, and manage your reading lists — all through natural language.

Deploying Kimi K2.5 on Azure: A Complete Guide to Running MoonshotAI's Model Learn how to deploy and configure Kimi K2.5 on Azure AI Foundry with this step-by-step guide.

Deploying #Kimi K2.5 on #Azure: A Complete Guide to Running MoonshotAI's Model suraj.io/post/2026/de...

Running Pydantic’s Monty Rust sandboxed Python subset in WebAssembly There’s a jargon-filled headline for you! Everyone’s building sandboxes for running untrusted code right now, and Pydantic’s latest attempt, Monty, provides a custom Python-like language (a subset of ...

Running Pydantic’s Monty Rust sandboxed Python subset in WebAssembly

simonwillison.net/2026/Feb/6/p...

Handy Handy is a cross platform, open-source, speech-to-text application for your computer

Thanks to @scott.hanselman.com for showing me Handy (handy.computer) — a free, open-source speech-to-text tool that runs locally on your machine. Push-to-talk, privacy-focused, and just works. Check it out!

Running Docker Commands on a Remote Machine via SSH Learn how to execute Docker commands on a remote machine from your local terminal using SSH and Docker contexts

Running Docker Commands on a Remote Machine via SSH suraj.io/post/2026/re...

#docker #ssh #remote #containers #cli #development #devops

Using Claude Code with GitHub-Hosted Anthropic Models Learn how to use Claude Code CLI with GitHub Models by proxying requests through litellm-proxy

Using Claude Code with GitHub-Hosted Anthropic Models suraj.io/post/2026/us... #claude #github-models #ai #litellm #anthropic

Meta’s Kubernetes-based Portable AI Research Environment - Shaun Hopper, Meta & Navarre Pratt YouTube video by CNCF [Cloud Native Computing Foundation]

Meta’s Kubernetes-based Portable AI Research Environment youtu.be/ts7bI51gRCo?...

LLMs on Kubernetes: Squeeze 5x GPU Efficiency With Cache, Route, Repea... Yuhan Liu & Suraj Deshmukh YouTube video by CNCF [Cloud Native Computing Foundation]

Our talk (me & Yuhan Liu) on improving LLM serving efficienty is on YouTube now!
youtu.be/2YCDvZokqnk?...

#vllm #kubernetes #kubecon

Infinite scale: The architecture behind the Azure AI superfactory - The Official Microsoft Blog Today, we are unveiling the next Fairwater site of Azure AI datacenters in Atlanta, Georgia. This purpose-built datacenter is connected to our first Fairwater site in Wisconsin, prior generations of A...

Infinite scale: The architecture behind the Azure AI superfactory

blogs.microsoft.com/blog/2025/11...

Trying out Gemini 3 Pro with audio transcription and a new pelican benchmark Plus what happens if AI labs train for pelicans riding bicycles?

Gemini 3, Open AI kv cache and much more
open.substack.com/pub/simonw/p...

and also allow you to do kv cache offload to local storage for 24hrs! Also they cache only when the query is greater than 1024 tokens!

OpenAI Platform Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.

Open AI gave some of the details from the user POV as to what kv cache features are available 
platform.openai.com/docs/guides/...

It is interesting to see that they cache for 10 min and if no request is found they remove hot caches from GPU

Microsoft AI superfactory Microsoft unveiled its second Fairwater AI datacenter in Atlanta as part of a new AI superfactory working across states in nearly real time.

From Wisconsin to Atlanta: Microsoft connects datacenters to build its first AI superfactory

news.microsoft.com/source/featu...

Satya Nadella – How Microsoft thinks about AGI YouTube video by Dwarkesh Patel

Satya Nadella – How Microsoft thinks about AGI
youtu.be/8-boBsWcr5A?...

Keynote: How One Line of Code Freed 30,000 CPU Cores: Deep-Diving Fluent Bit at Petabyte... F. Ponce YouTube video by CNCF [Cloud Native Computing Foundation]

How One Line of Code Freed 30,000 CPU Cores: Deep-Diving Fluent Bit at Petabyte Scale www.youtube.com/watch?v=pbOv...

Come see us (me & Yuhan Liu) tomorrow for our talk.

Specifically, Wednesday November 12, 2025 5:30pm - 6:00pm EST at Building B | Level 5 | Thomas Murphy Ballroom 1.

More info: sched.co/27FcQ #kubecon #vllm

Ray Direct Transport: RDMA Support in Ray Core (Part 1) Ray Direct Transport enables fast and direct GPU transfers in Ray via RDMA-backed transports. Using RDT, we can achieve up to 1000x faster GPU-GPU transfers than Ray’s native object store with a few l...

Announcing Ray Direct Transport: RDMA Support in Ray Core
www.anyscale.com/blog/ray-dir...

This has become whackamole now, source: www.youtube.com/watch?v=AXN-...

I ran the following command in Mac's terminal to get Chrome working with uBlock Origin:

```
open -a /Applications/Google\ Chrome.app --args --disable-features=ExtensionManifestV2Unsupported,ExtensionManifestV2Disabled
```

Building a tool to copy-paste share terminal sessions using Claude Code for web Plus Living dangerously with Claude, and prompt injection risks for ChatGPT Atlas

Building a tool to copy-paste share terminal sessions using Claude Code for web
open.substack.com/pub/simonw/p...

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference Today's LLM inference systems treat individual engines and queries independently for simplicity, but this causes significant resource inefficiencies. While there are proposals to avoid redundant compu...

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference
arxiv.org/abs/2510.09665

Understanding Memory Management on Hardware-Coherent Platforms | NVIDIA Technical Blog If you’re an application developer or a cluster administrator, you’ve likely seen how non-uniform memory access (NUMA) can impact system performance. When an application is not fully NUMA-aware…

Understanding Memory Management on Hardware-Coherent Platforms | NVIDIA Technical Blog developer.nvidia.com/blog/underst...

KubeCon + CloudNativeCon North America 2025: LLMs on Kubernetes: Squeeze 5x GPU Effic... View more about this event at KubeCon + CloudNativeCon North America 2025

Join me and Yuhan Liu for our talk at the upcoming #Kubecon NA 2025 in Atlanta: sched.co/27FcQ we will talk about increasing efficency while serving #LLMs using #vLLM & #LMCache!

Using Claude Code but with Github Copilot hosted Claude models:
github.com/surajssd/dot...

TFS @nilekh.bsky.social

NVIDIA Blackwell Leads on SemiAnalysis InferenceMAX v1 Benchmarks | NVIDIA Technical Blog SemiAnalysis recently launched InferenceMAX v1, a new open source initiative that provides a comprehensive methodology to evaluate inference hardware performance. Published results demonstrate that…

NVIDIA Blackwell Leads on SemiAnalysis InferenceMAX v1 Benchmarks | NVIDIA Technical Blog developer.nvidia.com/blog/nvidia-...

Claude Code: Tips and Tricks YouTube video by Anand Tyagi

Claude Code: Tips and Tricks

youtu.be/HSkLeECsBcw?...