Generally Available: Open-source feature update: vLLM model serving in KAITO

Microsoft announced general availability of this Azure Kubernetes Service (AKS) update in December 2024.

Launched1 version

Facts

Microsoft id
471285
Status
Launched
Products
Azure Kubernetes Service (AKS)
Update type
Open Source
Product categories
Compute, Containers
General availability
December 2024
Status pages
Azure Kubernetes Service (AKS) status
First captured by us
(from our first import of this list)
Microsoft last modified
Source
Azure Updates · open the original at Microsoft

Microsoft says

KAITO now supports high throughput model serving with the open-source vLLM serving engine. In the KAITO inference workspace, you can deploy models using vLLM to

Azure Updates,

Read Microsoft's full post

What Microsoft changed

One version so far. If Microsoft edits it, each change shows here with what was removed and added.

  1. First version we captured ·

    As first seen: Launched
    Status
    Launched

    Seen by us · Microsoft's timestamp · Microsoft's page

Other changes for Azure Kubernetes Service (AKS)

Last updated