Running DeepSeek-R1 on a single NDv5 MI300X VM

Contributors: Davide Vanzo, Yuval Mazor, Jesse Lopez DeepSeek-R1 is an open-weights reasoning model built on DeepSeek-V3, designed for conversational AI, coding, and complex problem-solving. It has gained significant attention beyond the AI/ML community due to its strong reasoning capabilities, often competing with OpenAI’s models. One of its key advantages…

01/02/2025Azure High Performance Computing (HPC) Blog

Share:

You may be interested in

Optimizing Language Model Inference on Azure
Azure High Performance Computing (HPC) Blog,
By Shantanu Deepak Patankar, Software Engineer Intern, and Hugo Affaticati, Technical Program Manager 2 Inefficient inference optimization can lead to skyrocketing costs for customers, making it crucial to establish clear…
02/10/2024
Ramp up with me… on HPC: Understanding Virtual Machines, CPUs, and GPUs
Azure High Performance Computing (HPC) Blog,
There are a lot of different products you need to successfully complete a high-performance computing (HPC) workload. You’ll hear several terms regularly, like virtual machines, CPUs, GPUs, compute power, and…
31/08/2023
Creating a Slurm Job Submission App in Open OnDemand with Copilot Agent
Azure High Performance Computing (HPC) Blog,
High Performance Computing (HPC) environments are essential for research, engineering, and data-intensive workloads. To efficiently manage compute resources and job submissions, organizations rely on robust scheduling and orchestration tools. In…
21/07/2025
Microsoft adopts NVIDIA Blackwell to power the next frontier of AI supercomputing
Azure High Performance Computing (HPC) Blog,
We are pleased to announce the launch of the first cloud private preview of the Azure ND GB200 V6 VM series, based on the NVIDIA accelerating computing platform. This latest…
19/11/2024
New Azure NC H100 v5 VMs Optimized for Generative AI and HPC workloads is now Generally Available
Azure High Performance Computing (HPC) Blog,
Azure NC H100 v5 virtual machines (VMs) are an excellent platform for executing diverse AI and High-Performance Computing (HPC) workloads. These workloads demand substantial computational power, large capacity of high-performance…
18/03/2024
Accelerating OpenFOAM Integration with Azure CycleCloud
Azure High Performance Computing (HPC) Blog,
OpenFOAM, which stands for Open Field Operation and Manipulation, is a free, open-source software framework primarily used for computational fluid dynamics (CFD) simulations. It provides a wide range of numerical…
13/02/2024
Monitoring HPC & AI Workloads on Azure H/N VMs Using Telegraf and Azure Monitor (GPU & InfiniBand)
Azure High Performance Computing (HPC) Blog,
As HPC & AI workloads continue to scale in complexity and performance demands, ensuring visibility into the underlying infrastructure becomes critical. This guide presents an essential monitoring solution for AI…
24/04/2025
Deploying Siemens NX/X on Azure Virtual Desktop: Multi-Session GPU Sharing for CAD Workloads
Azure High Performance Computing (HPC) Blog,
Workflow NX users access the NX application deployed on Azure Virtual Desktop via Remote Desktop Application (RDP). User can access the NX application either login into the Session Desktop or…
20/06/2025
3 ways HPC supports innovation in manufacturing
Azure High Performance Computing (HPC) Blog,
Download the eBook 1 IDC, High-Performance Computing: Game Changer in the Manufacturing Industry, 2022. 2 Hyperion Research, HPC Market Update: HPC/AI Market Results, and High Growth Areas, 2023.…
17/09/2024
Training large AI models on Azure using CycleCloud + Slurm
Azure High Performance Computing (HPC) Blog,
Training large AI models on Azure using CycleCloud + Slurm In the past year generative AI models have leapt into common discourse through the popularity of text-to-image models and…
28/03/2023
Experience Next-Gen HPC Innovation: AMD Lab Empowers ‘Try Before You Buy’ on Azure
Azure High Performance Computing (HPC) Blog,
In today’s fast-paced digital landscape, High-Performance Computing (HPC) is a critical engine powering innovation across industries—from automotive and aerospace to energy and manufacturing. To keep pace with escalating performance demands…
11/03/2025
Integrating external Grid Engine Scheduler to CycleCloud (Cloud Bursting scenario)
Azure High Performance Computing (HPC) Blog,
Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High-Performance Computing (HPC) environments on Azure. With CycleCloud, users can provision infrastructure for HPC systems, deploy familiar HPC schedulers, and automatically scale…
13/03/2023