Running DeepSeek on AKS with Ollama

Introduction This guide provides step-by-step instructions on how to run DeepSeek on Azure Kubernetes Service (AKS). The setup utilizes an ND-H100-v5 VM to accommodate the 4-bit quantized 671-billion parameter model on a single node. Prerequisites Before proceeding, ensure you have an AKS cluster with a node pool containing at least one ND-H100-v5 instance. Additionally,…

31/01/2025Azure High Performance Computing (HPC) Blog

Share:

You may be interested in

Product Announcement: Open OnDemand Integration with Azure CycleCloud Workspace for Slurm
Azure High Performance Computing (HPC) Blog,
We are thrilled to announce the preview of Open OnDemand integration with Azure CycleCloud Workspace for Slurm. Open OnDemand, developed by the Ohio Supercomputer Center (OSC), is an open-source, web-based…
27/03/2025
Migrating existing HPC workloads from Azure Cyclecloud to Azure Batch
Azure High Performance Computing (HPC) Blog,
Understanding Azure Batch for HPC Azure Batch is a cloud-based service provided by Microsoft Azure that's designed to handle HPC workloads efficiently. It's known for its simplicity and versatility,…
16/10/2023
Where Does One Machine End and the Next Begin?
Azure High Performance Computing (HPC) Blog,
The process of integrating Azure HPC into Azure has raised many questions about why we do things differently from the general-purpose fleet. It turns out, though, that we don’t work…
13/07/2024
Starting HPC Worker Processes at Boot Time in VM Scale Sets
Azure High Performance Computing (HPC) Blog,
One is deploying an HPC embarrassingly parallel application in Azure Virtual Machine Scale Sets (VMSSs) and realized that (i) ssh into VM instances is possible even when they have not…
26/06/2023
Add a new Partition to a running CycleCloud SLURM cluster
Azure High Performance Computing (HPC) Blog,
Overview Azure CycleCloud (CC) is a user-friendly platform that orchestrates High-Performance Computing (HPC) environments on Azure, enabling admins to set up infrastructure, job schedulers, filesystems and scale resources efficiently at…
03/08/2024
GPU node health checks integrated into Azure Kubernetes service via node problem detector
Azure High Performance Computing (HPC) Blog,
Introduction Large AI model training can take months to complete on very large AI supercomputers. These AI supercomputers consist of many high-end GPU’s (e.g NVIDIA A100 or H100)…
27/06/2024
Running DeepSeek-R1 on a single NDv5 MI300X VM
Azure High Performance Computing (HPC) Blog,
Contributors: Davide Vanzo, Yuval Mazor, Jesse Lopez DeepSeek-R1 is an open-weights reasoning model built on DeepSeek-V3, designed for conversational AI, coding, and complex problem-solving. It has gained significant attention…
01/02/2025
Scaling Up in the Cloud: The WEKA Data Platform and Azure HPC Windows Grid Integration
Azure High Performance Computing (HPC) Blog,
Co-Written with Erik Garcia, WEKA Director of Cloud Sales, Brian Markenson, WEKA System Engineer, & Adam Fowler, WEKA System Engineer High Performance Compute (HPC) grids in the Financial Services Industry are unique…
28/02/2024
New Azure NC H100 v5 VMs Optimized for Generative AI and HPC workloads is now Generally Available
Azure High Performance Computing (HPC) Blog,
Azure NC H100 v5 virtual machines (VMs) are an excellent platform for executing diverse AI and High-Performance Computing (HPC) workloads. These workloads demand substantial computational power, large capacity of high-performance…
18/03/2024
Introducing the Azure NMads MA35D: Exclusive Media Processing Powerhouse in the Cloud
Azure High Performance Computing (HPC) Blog,
Azure is proud to announce the exclusive launch of the NMads MA35D Virtual Machine (VM) – a groundbreaking addition to our portfolio specifically designed to redefine media processing and video…
03/10/2024
Building an Automated Recovery Pipeline for GPU Clusters with Slurm on Azure Part 2
Azure High Performance Computing (HPC) Blog,
Disclaimer: The slurm-cluster-health-manager project is a sample tool created specifically for the article it accompanies. This is not an official Microsoft product, and it is not supported or maintained by Microsoft.…
13/06/2025
Accelerating NAMD on Azure HB-series VMs
Azure High Performance Computing (HPC) Blog,
Authors: Amirreza Rastegari, Nihit Pokhrel, Nathan Baker, Jon Shelley Introduction: Nanoscale Molecular Dynamics (NAMD) is a molecular dynamics program designed for high-performance simulation of large biomolecular systems. The program…
22/03/2023