Karl Podesta

- YouTube Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

Optimize your HPC workloads by choosing the right hardware—CPUs for memory-intensive workloads, avoiding GPU-induced complexities and latencies. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing #azurehpc

Release OCS/GCS v9.0.5 · hpc-gridware/clusterscheduler Major Enhancements v9.0.5 qtelemetry (Developer Preview in GCS) This release introduces qtelemetry, a new metrics exporter for Gridware Cluster Scheduler (GCS). It allows administrators to easily c...

New Open #ClusterScheduler and and fully QAed #Gridware #ClusterScheduler packages will be available soon (v9.0.5). github.com/hpc-gridware... #HPC #HTC #AI #Grafana #Cluster #GridEngine

Ha, I am featured on the #ISC25 registration page along with a bunch of my favorite Microsoft colleagues. I wonder if I can cash this in for a discount on registration.

Sadly, it's mostly the side of my head that is featured. @karlpodesta.bsky.social should probably get the bigger discount.

a man in a suit and tie is sitting at a table with his hands up ALT: a man in a suit and tie is sitting at a table with his hands up

Hmm. “Karl has a bigger head” vs “ISC discount”… 🤔

Phew. And I’m just finished reading rather than attending! Enjoyed all your insights - but particularly those on resilience techniques & scheduling/orchestration preferences observed. Amazing write up, Glenn!

I've published some notes I took while at #GTC25 last week. Have a look: https://blog.glennklockwood.com/2025/03/gtc-2025-recap.html

Part of why I write is to foster discussion, and I'd love to hear or read others' takes on the conference!

#AI

- YouTube Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

Boost your HPC workloads with Azure's HB-series VMs, offering an 8x generation-over-generation improvement in memory bandwidth powered by AMD’s custom processors, only available on Azure. Get started. youtu.be/NGuVGM6amsw #HPCinAzure #microsoftazure #hpc #microsoft #highperformancecomputing

Revolutionizing HPC with Serverless Computing High-Performance Computing (HPC) has traditionally been associated with specialized clusters of powerful servers, complex scheduling systems, and rigorous performance optimizations. Over the years, HPC has been a driving force behind groundbreaking research in physics, genomics, climate science, financial modeling, and more. Today, however, we find ourselves at an interesting crossroads: serverless computing has come of age, and the potential to meld it with HPC is opening new vistas of efficiency and cost-effectiveness.

Power up HPC with #Serverless! Learn how to optimize performance, slash costs, and scale in the cloud. Check out our deep dive with #AzureFunctions & #AWSLambda. #HPC #CloudComputing #CloudDailywire

Understanding Simulation Operations (SimOps) Simulation Operations (SimOps) is a strategic framework designed to optimize and automate simulation processes within engineering and product development. As products become increasingly complex and interconnected, the role of simulations in validating designs, testing hypotheses, and driving innovation becomes more critical. SimOps aims to streamline these processes, enhancing productivity and enabling faster, data-driven decision-making.Core Principles of SimOpsSimOps is built upon a foundatio

Simulations are crucial for modern product development, but managing them can be complex. This blog explores SimOps, a framework designed to make your simulation workflows smoother and more efficient. Read on to learn more!

Cool! … I think there are still quite a few places where we all wish the wheels would have fallen off by now, but they haven’t… ! 🤷

Looks great! Cool that you can use breakpoints! Helpful to see you step through it all :-)

The MATLAB extension for Visual Studio Code. Now with Debugging support! YouTube video by Michael Croucher

I just made my first YouTube video showing off the new MATLAB extension for Visual Studio Code www.youtube.com/watch?v=EWRP...

Waaaay out of my comfort zone here!
Maybe like and subscribe to help me feel better? ;)

Aider AI, the command-line code assistant, is phenomenal I'm currently working on the final chapter of our book! It's the DevOps chapter, which for a while, I thought would probably be about LLMOps or GenAIOps. But I …

Finally! I get it when people say that AI can be used for automation. I just used gpt-4o-mini, aider and PowerShell to rewrite 700+ of my tests.

foreach ($test in $tests) {
aider --message "$prompt" --file $test.FullName --model azure/gpt-4o-mini --no-stream
}

#OpenAI #aider #PowerShell

FOSDEM 2025 - HPC, Big Data & Data Science

Woohoo! Decisions have been made on the @fosdem.bsky.social'25 HPC, Big Data & Data Science DevRoom talks and the schedule is beginning to populate at fosdem.org/2025/schedul... for what will eventually be a full day of talks in Brussels Sunday 2 February 2025 with recording and streaming available.

Sometimes you get a good boss. If you get one, appreciate them. We have regular “Connect” reviews, and my boss takes them seriously. He rejected mine last week and redlined it. I was upset, then fixed and returned it. He was right, and the changes set me up for success. Darn it for being right lol.

Yes, Quantum MPI was a thing, even at #SC21 with @microsoft.com.

arxiv.org/abs/2105.01109

Better late than never ;-).

EPISODE 6 - Scott & Mark Learn To... Take a Dump YouTube video by Scott Hanselman

The next episode of our Scott and Mark Learn To podcast series is out. In this one, we learn how to...take a dump!

I hope we can improve our community collaborations amongst these topics in future. I guess it’s finding right people at the right time to pitch in. It’s nice to see & learn from others’ collaborations! Plus, cool cards :-)

Congratulations Vanessa and team! It’s nice to see this work! Nobody from #azure wanted to join the party…? *sniff*

A visualisation of the nano-gpt LLM

Really interesting interactive visualization and demonstration of how Large Language Models (LLMs) work. These form the basis of technologies such as ChatGPT. bbycroft.net/llm 🧪

Who knows what they’re doing in there! *cut to people quietly working on their computers*

I guess we’re not all here at the same time! There are two big offices beside each other (photo of the biggest), but also the DCs and smaller acquisitions (Havok, Activision/Demonware, Nuance, LinkedIn?) possibly included in that number. Wish we had SFO weather & cool factor!

Part of my “new” job (#azure #batch #HPC) means I come to the Dublin office a lot more (i.e. “at all”). It’s a pretty nice place, and pretty busy today - there’s an all hands and a Christmas party. I can feel the buzz! Almost 4000 people work across whole site. People! #microsoftlifeireland

Hmm. But maybe not cooler… A screenshot or workflow demo doesn’t really compare with gorey photos of physical CPUs and Chassis and flashing lights and cables!

Glenn, this is an awesome post. I love the detail & categories & takes. If I was to wish for something even more... it would be for the same from someone else focusing on (1) software & ops, and (2) science impact. We need more Glenns. We could mass produce & sell by the thousand, etc.

SC'24 recap The premiere annual conference of the high-performance computing community, SC24, was held in Atlanta last week, and it attracted a reco...

I spent the Thanksgiving break typing up my notes from #SC24 which I've posted online. 30% more words than my notes from SC23 (sorry!). Feedback is welcome!

https://buff.ly/41fBhho

#HPC

We could not have articulated it better.

In our view EasyBuild or Spack are not good enough anymore.

They’re both essential tools, and will remain so going forward, but we need to take the next step and go beyond them, and collaborate even more on a shared stack of software *installations*.

#HPC

I love this write up. Not least for the references to (& photo of!) Bill Gates at SC05, almost 20 years ago, showing off a #windows #hpc capability that somewhat lives in my current group at work :-)

Thank you for the shout out @underfox3.bsky.social.
Thomas Jakobsche - the lead author and my soon to graduate PhD student will be happy to learn about it.
@dmi-hpc.bsky.social
#HPC #Security @unibasel.bsky.social

Record-breaking run on Frontier sets new bar for simulating the universe in exascale era The universe just got a whole lot bigger—or at least in the world of computer simulations, that is. In early November, researchers at the Department of Energy's Argonne National Laboratory used the…

New supercomputer, new record-breaking HACC run. This job ran a single job over 9,000 nodes on Frontier—an impressive feat, and a proof point that Frontier is prime time.

https://buff.ly/3CRqMH1

#HPC