Kosseila (CloudDude)

🎙𝗧𝗲𝗰𝗵𝗯𝗲𝗮𝘁𝘀 𝘂𝗻𝗽𝗹𝘂𝗴𝗴𝗲𝗱 #Episode09 is live !!!👊🏻
"𝗧𝗵𝗲 𝗜𝗻𝗴𝗹𝗼𝗿𝗶𝗼𝘂𝘀 𝗖𝗹𝗼𝘂𝗱 𝗧𝗿𝗮𝗽𝘀☁️" With @markboost.com CEO of @civo.com
👉🏻 Listen here: sptfy.bio/TBeats09 👈🏻

☁️ 𝗜𝘀 𝘁𝗵𝗲 𝗖𝗹𝗼𝘂𝗱 𝗯𝗿𝗼𝗸𝗲𝗻 ...𝗼𝗿 𝗷𝘂𝘀𝘁 𝘂𝗻𝗳𝗮𝗶𝗿?
Grab your 🎧 and Tune IN! let's uncover the ☁️#traps!
📺 One the best 𝗧𝗲𝗰𝗵𝗕𝗲𝗮𝘁𝘀 show so far !

vLLM Production Stack on Nebius K8s with Terraform🧑🏼‍🚀 - Cloudthrill This terraform stack delivers a production-ready vLLM serving environment On Nebius Cloud managed Kubernetes supporting Highly optimized GPU inference with operational best practices.

📢 𝗡𝗲𝘄 𝘁𝗲𝗿𝗿𝗮𝗳𝗼𝗿𝗺 #vLLM 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘁𝗮𝗰𝗸 𝗔𝗰𝗿𝗼𝘀𝘀 𝗖𝗹𝗼𝘂𝗱𝘀 🧑🏼‍🚀 | 𝗣𝗮𝗿𝘁 𝟰: 𝗡𝗲𝗯𝗶𝘂𝘀 𝗖𝗹𝗼𝘂𝗱 💚

🔎 𝗪𝗵𝗮𝘁 𝘆𝗼𝘂'𝗹𝗹 𝗱𝗲𝗽𝗹𝗼𝘆:
✅ Enterprise-grade GPU inference
✅ Secure vllm endpoints (LetsEncrypt)
✅ Full observability: Grafana + vLLM dashboards
✅ Lightning-fast deployment

👉 read the guide: tinyurl.com/Nebiusvllm

🎄This week, we’re counted down CloudThrill’s 𝗧𝗼𝗽 𝟯 𝗺𝗼𝘀𝘁-𝗿𝗲𝗮𝗱 blog posts of 𝟮𝟬𝟮𝟱🏆.
Three posts. Three lessons. First reveal drops this Monday 👀

#CloudThrill #LLM #AIInfrastructure #LLM #OpenSourceAI #AIEngineering

🎙𝗧𝗲𝗰𝗵𝗯𝗲𝗮𝘁𝘀 𝘂𝗻𝗽𝗹𝘂𝗴𝗴𝗲𝗱 is BACK #Episode 08 !!!👊🏻
"𝗡𝘂𝘁𝗮𝗻𝗶𝘅 𝗶𝗻 𝘁𝗵𝗲 𝗔𝗴𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗩𝗶𝗿𝘁𝘂𝗮𝗹𝗶𝘇𝗮𝘁𝗶𝗼𝗻 𝗦𝗵𝗮𝗸𝗲-𝗨𝗽 " 🎧🔥
🔥New episode out with Michael Webster from Nutanix & I- breaking down the #VMware–Broadcom chaos, #Nutanix, and real exit strategies.
👉🏻 Listen here: sptfy.com/TBeats08 👈🏻

vLLM Production Stack on GCP GKE with Terraform🧑🏼‍🚀 - Cloudthrill This terraform stack delivers a production-ready vLLM serving environment On Google Cloud GKE supporting both CPU/GPU inference with operational best practices embedded in Terraform Kubernetes Engine Modules.

📢 𝗡𝗲𝘄 𝘁𝗲𝗿𝗿𝗮𝗳𝗼𝗿𝗺 #vLLM 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘁𝗮𝗰𝗸 𝗔𝗰𝗿𝗼𝘀𝘀 𝗖𝗹𝗼𝘂𝗱𝘀
𝗣𝗮𝗿𝘁 𝟭: GCP 𝗚𝗞𝗘 🔵🔴🟢
🔎 𝗪𝗵𝗮𝘁 𝘆𝗼𝘂'𝗹𝗹 𝗱𝗲𝗽𝗹𝗼𝘆:
✅ Enterprise-grade infra
✅ Switch between CPU/ GPU inference with a single flag
✅ Full observability: Grafana + vLLM dashboards
✅ OpenAI-compatible API

👉 read the guide: cloudthrill.ca/vllm-product...

🎙️Top 5 new VLLM features 2026! with Simon Mo @ 𝗥𝗮𝘆 𝗦𝘂𝗺𝗺𝗶𝘁 YouTube video by CloudDude

🩵 Throwback Thursday from #𝗥𝗮𝘆𝗦𝘂𝗺𝗺𝗶𝘁 𝗦𝗙!
I Caught up with 𝗦𝗶𝗺𝗼𝗻 𝗠𝗼, lead on #vllm project, to chat about the 𝘁𝗼𝗽 𝟱 𝗻𝗲𝘄 𝘃𝗟𝗟𝗠 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 and what’s cooking in their 𝟮𝟬𝟮𝟲 𝗿𝗼𝗮𝗱𝗺𝗮𝗽 straight from the source🔥and boy did he deliver!! #vLLM #RaySummit2025 #anyscale @cloudthrill.bsky.social #OpenSourceAI

#Nebius an European-born AI Supercloud with one of the wildest origin stories in the cloud world. 😎

👉 Read the full story: cloudthrill.ca/explore-nebius-ai-cloud

👀History, GPU lineup & presets, network, regions, CLI setup, pricing - all covered

#Nebius #AICloud #LLMOps #AI #NeoCloud #GPU

vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀 - Cloudthrill This terraform stack delivers a production-ready vLLM serving environment On Amazon EKS supporting both CPU/GPU inference with operational best practices embedded in AWS Integration and Automation (aws-ia).

📢 𝗡𝗲𝘄 𝘁𝗲𝗿𝗿𝗮𝗳𝗼𝗿𝗺 vLLM 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘁𝗮𝗰𝗸 𝗔𝗰𝗿𝗼𝘀𝘀 𝗖𝗹𝗼𝘂𝗱𝘀
𝗣𝗮𝗿𝘁 𝟭: 𝗔𝗺𝗮𝘇𝗼𝗻 𝗘𝗞𝗦
🔎 𝗪𝗵𝗮𝘁 𝘆𝗼𝘂'𝗹𝗹 𝗱𝗲𝗽𝗹𝗼𝘆:
✅ Enterprise-grade infra
✅ Switch between CPU/ GPU inference with a single flag
✅ Full observability: Grafana + vLLM dashboards
✅ OpenAI-compatible API

👉 Check it out: cloudthrill.ca/vllm-product...

Still thinking of hosting your on AI Backend?
our FREE vLLM POC is still live - but not forever.
📢𝗔𝗽𝗽𝗹𝘆 𝗻𝗼𝘄 → cloudthrill.ca/ai-poc

Run AI assistants, RAG, or open models privately in the cloud:
✅ No external APIs
✅ No vendor lock-in
✅ Total data control

Your Infra. Your Models. Your rules.🏆🏁

𝗖𝗹𝗼𝘂𝗱𝗧𝗵𝗿𝗶𝗹𝗹 𝗡𝗲𝘄 𝗟𝗮𝘂𝗻𝗰𝗵: 𝗢𝘂𝗿 𝐀𝐈 𝐏𝐫𝐢𝐯𝐚𝐭𝐞 𝐈𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐒𝐞𝐫𝐯𝐢𝐜𝐞 (+ FREE POC) YouTube video by CloudThrill

🚨𝐍𝐞𝐰 𝐋𝐚𝐮𝐧𝐜𝐡:
🎇Today, we’re excited to launch our 𝐀𝐈 𝐏𝐫𝐢𝐯𝐚𝐭𝐞 𝐈𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐒𝐞𝐫𝐯𝐢𝐜𝐞: powered by Open source AI stack.

To celebrate we offer a 𝐅𝐑𝐄𝐄 𝐕𝐋𝐋𝐌 POC in any cloud you choose! Apply Now! Only 5 spots available.👉🏼 cloudthrill.ca/ai-poc

youtu.be/i_vIrOH8I3E?...

LLM Embeddings Explained Like I’m 5 - Cloudthrill Curious what LLM embeddings really are and how they power tools like RAG? This guide breaks it down simply - from text-to-vector magic to fast retrieval. Bonus: explore how KV cache speeds up inference in vLLM.

✍🏻#NewBlog 𝗟𝗟𝗠 𝗘𝗺𝗯𝗲𝗱𝗱𝗶𝗻𝗴𝘀 𝗘𝘅𝗽𝗹𝗮𝗶𝗻𝗲𝗱 (Like I’m 5)
You’ve heard of RAG, vector DBs, and embeddings... 🤔
But what are 𝐞𝐦𝐛𝐞𝐝𝐝𝐢𝐧𝐠𝐬 really, and why do they matter?
learn all about it and how it works in this 5 minute post
👇🏼 cloudthrill.ca/llm_embeddin...

#LLM #Embeddingmodels #AI #RAG #VectorDB

vLLM production-stack: LLM inference for Enterprises (part1) - Cloudthrill vLLM Production Stack tackles usual issues that come with scaling LLM serving (slow recovery, High GPU bills) with a community-maintained layer that wraps vanilla vLLM, adds a Python-native router, LMCache-powered KV-cache network, autoscaling hooks and Grafana dashboards—all deployable in a single Helm chart. Let's dive into it!✍🏻

🚀#NewBlog #vLLM
📖 𝐯𝐋𝐋𝐌 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐬𝐭𝐚𝐜𝐤: AI inference for enterprises💫

🏢Production-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.

👉Start here: cloudthrill.ca/vllm-product...

#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache

Love them #Newbalance 👟 😅

📦#vLLM for 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐛𝐮𝐧𝐝𝐥𝐞: from basics to deployment! 👇Missed our vLLM series this summer? Here’s a full recap
Part1️⃣: 𝐅undamentals cloudthrill.ca/what-is-vllm
Part2️⃣: 𝐊ey 𝐅eatures cloudthrill.ca/what-is-vllm...
part3️⃣: 𝐃eployment 𝐎ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs

Kelsey Hightower surprise HIP-HOP Quiz (Ep 03 Bonus) YouTube video by CloudDude

🎙️You've never heard @kelseyhightower.com discuss this topic before! Zero to do with tech!😎 Enjoy this #HIPHOP deep dive... Thanks Kelsey #FunTimes #ThursdayPods #Breakdance

youtu.be/aAbbSk2F-Xs?...

Recursive `.𝑔𝑖𝑡𝑖𝑔𝑛𝑜𝑟𝑒`: When Ignoring Goes Too Far - Cloudthrill Learn how to debug and fix the recursive .gitignore issue in Git repositories. Avoid unintended file exclusions and master .gitignore best practices with this comprehensive guide.

#NewBlog⛔ #𝑔𝑖𝑡𝑖𝑔𝑛𝑜𝑟𝑒 𝑔𝑜𝑛𝑒 𝑤𝑟𝑜𝑛𝑔🚫
🔁𝐑𝐞𝐜𝐮𝐫𝐬𝐢𝐯𝐞 𝒈𝒊𝒕𝒊𝒈𝒏𝒐𝒓𝒆: "𝘞𝘩𝘦𝘯 𝘐𝘨𝘯𝘰𝘳𝘪𝘯𝘨 𝘎𝘰𝘦𝘴 𝘛𝘰𝘰 𝘍𝘢𝘳"
👉Read here: tinyurl.com/gitignorez

✅ The Usual suspects: Broad Wildcards, nested files
✅ Recursive directory matching & Trailing "/"
✅ How to stop recursive chaos before it hits prod

#DevOps #GitHub #GitLab #CICD

HashiCorp Vault for Dummies: K8s Auth setup in an External Vault (WSL) - Cloudthrill In this post, we’ll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull secrets without hardcoded tokens. We’ll walk through using the TokenReview API, handling service account tokens in modern K8s , and securely wiring Vault to your cluster for workload identity.

🚀 #NewBlog @hashicorp.com Vault blog series
𝐏𝐚𝐫𝐭 𝟑: 𝐒𝐞𝐭𝐮𝐩 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 𝐀𝐮𝐭𝐡𝐞𝐧𝐭𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐰𝐢𝐭𝐡 𝐕𝐚𝐮𝐥𝐭
👉 tinyurl.com/k8sAuthVault

💡In this 5 minutes tuto you'll learn:
✅ Diff Vault auth scenarios for k8s
✅ Setup up K8s Vault Auth with SA/Client JWT & OIDC

#k8s #HashiCorp #Vault #SecretsManagement #DevOps

How to pass the GitHub Actions certification (cheat-sheet) - Cloudthrill 🎯Everything you need to pass the GitHub Actions certification in one place. ✔️ Clear examples, ✔️Cheat Sheet ✔️CLI syntax, and what to expect in the test.

🚀 #NewBlog How to 𝐏𝐚𝐬𝐬 𝐭𝐡𝐞 𝐆𝐢𝐭𝐇𝐮𝐛 𝐀𝐜𝐭𝐢𝐨𝐧𝐬 𝐂𝐞𝐫𝐭𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧!
👉Complete guide here cloudthrill.ca/how-i-passed...
🎯 I included all you need to ace it:
✅Free exam practice
✅ Most exhaustive Cheat Sheet (all topics covered)
✅CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions

vLLM for beginners: Deployment Options (PartIII) - Cloudthrill In this final part, we’ll shift from theory to practice, covering how to deploy vLLM across different environments, from source builds to docker containers. In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a de facto choice for LLM deployment.

🚀#BlogSeries #vllm🔥
𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐏𝐚𝐫𝐭 𝟑:📖 𝐃𝐞𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭 𝐎𝐩𝐭𝐢𝐨𝐧𝐬
Learn to deploy #vLLM everywhere! Even on CPU🤫

✅Platform & model Support Matrix
✅Install on GPU & CPU
✅Build Wheel from scratch | Python vLLM package
✅Docker/Kubernetes Deployment
✅Running vLLM server (Offline + Online inference)

Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus) - Cloudthrill Today we’ll show you how to deploy an end-to-end Kubernetes cluster on a Civo Cloud with terraform . You’ll learn how to build and automate a cluster with Traefik, cert manager , letsencrypt issuer, Grafana , Prometheus.

#NewBlog from 𝐙𝐞𝐫𝐨 𝐭𝐨 @CivoCloud 🚀
💎Deploy your full fledged Talos 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 stack with Terraform in one command.
check it out👉: tinyurl.com/CivoK8stf
✅ Includes Grafana, Prometheus, Let's Encrypt & more
📖 My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial

🔴TechBeats live : LLM Quantization "vLLM vs. Ollama" YouTube video by CloudDude

🎙️ Join our 🔴𝐓𝐞𝐜𝐡 𝐁𝐞𝐚𝐭𝐬 𝐋𝐢𝐯𝐞 Show!
🗓️ Thursday 17th 11:30 AM EDT
🎯 A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.

🔥Dope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat

🔗Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...

vLLM for beginners: Key Features & Performance Optimization(PartII) - Cloudthrill In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a defacto choice for LLM deployment.

🚀#NewBlog #vllm🔥
𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐏𝐚𝐫𝐭 𝟐:📖𝐊𝐞𝐲 𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬 & 𝐎𝐩𝐭𝐢𝐦𝐢𝐳𝐚𝐭𝐢𝐨𝐧s
💎 What makes #vLLM the Rolls Royce of inference?
👉check it out: cloudthrill.ca/what-is-vllm...

✅ #PagedAttention #PrefixCaching #ChunkedPrefill
✅ #SpeculativeDecoding #FlashAttention #lmcache
✅ Tensor & #PipelineParallelism⚡

Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC - Cloudthrill Struggling with Azure credential management in your CI/CD pipelines? Both Azure and GitHub Actions now support OpenID Connect (OIDC) for secure deployments by simplifying the process, and aligning with modern security practices. With GitHub’s OIDC provider, you can authenticate directly from your workflows using managed identities without the need for static access keys.

🚀#NewBlog 𝐆𝐢𝐭𝐇𝐮𝐛 actions Azure deploy with 𝐎𝐈𝐃𝐂!
💡Over 𝟐𝟑 𝐦𝐢𝐥𝐥𝐢𝐨𝐧𝐬 secrets were exposed in #GitHub last year💀 & 𝟓𝟎K+ #Huggingface tokens leaks every month!
🛡️Switch to 𝐬𝐞𝐜𝐫𝐞𝐭𝐥𝐞𝐬𝐬 with Pipeline identity now!
👉We show you how: cloudthrill.ca/github-actio...
#Azure #NHI #CICD #Terraform #ManagedIdentity

vLLM for beginners: The Fundamentals - Cloudthrill In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a defacto choice for LLM deployment.

🚀#NewBlogAlert "What is #vLLM ?"
We’re kicking off our 𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:📖 𝐓𝐡𝐞 𝐅𝐮𝐧𝐝𝐚𝐦𝐞𝐧𝐭𝐚𝐥𝐬💫
New to vLLM ? This one's for you👇🏻: cloudthrill.ca/what-is-vllm

✅ What is vLLM ( vLLM vs Ollama)
✅ Core Architecture (Engine, Sched, Execution, Memory)
✅ Offline and Online inference

Ep06: "GitHub Security horror stories " (with Steve Giguere) Tech Beats Unplugged · Episode

🎙𝐓𝐞𝐜𝐡 𝐁𝐞𝐚𝐭𝐬 𝐔𝐧𝐩𝐥𝐮𝐠𝐠𝐞𝐝 is BACK #Episode 06 !!!👊🏻
🎧🔥"𝐆𝐢𝐭𝐇𝐮𝐛 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐡𝐨𝐫𝐫𝐨𝐫 𝐬𝐭𝐨𝐫𝐢𝐞𝐬 with
#SteveGiguere "☢️...tons of 𝐚𝐭𝐭𝐚𝐜𝐤 𝐯𝐞𝐜𝐭𝐨𝐫𝐬, best practices, and a lot of laughs😅. You don't wanna miss this !
Thank you Steve🙏🏻
👉🏻 spoti.fi/4dYicES 👈🏻

🎙️𝐓𝐞𝐜𝐡 𝐁𝐞𝐚𝐭𝐬 𝐔𝐧𝐩𝐥𝐮𝐠𝐠𝐞𝐝 is back! new episode drops tomorrow!🔥👀Mystery guest. Bold truths. Shocking discoveries you’re not ready to hear😱 🎧Mics are hot, truths are hotter. Stay tunned !!😎
#TechPodcast #GitSecStory

#NewBlog 𝐊𝐕 𝗖𝗮𝗰𝗵𝗲 𝗘𝘅𝗽𝗹𝗮𝗶𝗻𝗲𝗱: like I'm 5😎
🧠Ever wondered what #KVCache really is in LLM inference? Forget the math-heavy blabla—this one's made to click !
👉check it out: cloudthrill.ca/kv_cache-exp...
@Cloud_Thrill
#vLLM #AIInfra #lmcache

🧠First thing to do when using Jules from google and connecting your GitHub..! #GoogleJules

HashiCorp Vault for Dummies: Setup your 1st Vault with TLS (WSL) - Cloudthrill n this guide, you'll learn how to set up a local Vault server using Raft storage and TLS in a WSL (Windows Subsystem for Linux) environment. Whether you're just starting with secrets management, prepp...

🚀 #NewBlogAlert 🛡️ #HashiCorpVault
I'm kicking off a 𝐕𝐚𝐮𝐥𝐭 𝐟𝐨𝐫 𝐃𝐮𝐦𝐦𝐢𝐞𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:🔐 𝐇𝐨𝐰 𝐭𝐨 𝐒𝐞𝐭 𝐔𝐩 𝐇𝐚𝐬𝐡𝐢𝐂𝐨𝐫𝐩 𝐕𝐚𝐮𝐥𝐭 with 𝐑𝐚𝐟𝐭 & 𝐓𝐋𝐒
👉check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social

Explore OCI DevOps: Pipeline your Terraform Stack from GitHub to OCI Event posted by about Explore OCI DevOps: Pipeline your Terraform Stack from GitHub to OCI on AIOUG.

🚨Catch me live at @AIOUG tomorrow!😎
Pumped to join India Oracle Users Group for a live session #OCIDevOps #Terraform
🗓️ May 16 | 🕗 8:30 AM EST / 6:00 PM IST
Save your spot: aioug.org/events/explo...