LLM-D 1.0 advances open, cost-efficient AI inference for production scale.
Context
What happened: Contributors announced the release of llm-d 1.0, an open source project for deploying and scaling large language model inference, now governed by the Cloud Native Computing Foundation (CNCF).
Key numbers: Founded in 2025 by Red Hat, IBM (NYSE: IBM), Google Cloud, CoreWeave and NVIDIA. More than 500 contributors from over 25 organizations.
Why it matters: The release adds multi-tenant quality of service, zero-downtime operations, a v1 configuration API and agent-aware serving, aimed at helping organizations control the economics of AI serving in production.