llm-d

@llm-d.ai.bsky.social

llm-d is a Kubernetes-native distributed inference serving stack providing well-lit paths for anyone to serve large generative AI models at scale. Learn more at: https://llm-d.ai