Public Preview: Default Inference with vLLM with AI Toolchain Operator Add-on

Microsoft announced a preview of this Azure Kubernetes Service (AKS) update in April 2025.

In preview1 version

Facts

Microsoft id
486721
Status
In preview
Products
Azure Kubernetes Service (AKS)
Update type
Features
Product categories
Compute, Containers
Preview
April 2025
Status pages
Azure Kubernetes Service (AKS) status
First captured by us
(from our first import of this list)
Microsoft last modified
Source
Azure Updates · open the original at Microsoft

Microsoft says

By default, the AI toolchain operator add-on now deploys model inferencing workloads using the high-throughput vLLM serving engine. vLLM

Azure Updates,

Read Microsoft's full post

What Microsoft changed

One version so far. If Microsoft edits it, each change shows here with what was removed and added.

  1. First version we captured ·

    As first seen: In preview
    Status
    In preview

    Seen by us · Microsoft's timestamp · Microsoft's page

Other changes for Azure Kubernetes Service (AKS)

Last updated