Azure Cloud Commanders Run open-sourced inference models in AKS using Kaito

[[{“value”:”Jorge Arteiro (https://www.linkedin.com/in/jorgearteiro) and Luke Murray (https://www.linkedin.com/in/ljmurray/) discuss running large language models in AKS with the Kubernetes AI Toolchain Operator (Kaito)!

Reference Links

* Microsoft Learning Rooms – https://techcommunity.microsoft.com/t5/custom/page/page-id/learn?WT.mc_id=AZ-MVP-5004796
* Kubernetes AI Toolchain Operator – https://github.com/Azure/kaito/tree/main
* Deploying Large Language Models on AKS with Kaito – https://luke.geek.nz/azure/run-local-llm-aks/

Learn More
Share:

You may be interested in

What you're searching for?

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors