Introducing Azure CycleCloud Slurm Workspace (Preview)
A new way to create and manage CycleCloud Slurm clusters on Azure Slurm is one of the most popular and widely used open-source workload managers for AI/HPC and cloud computing.…
04/06/2024
Performance of Llama 3.1 8B AI Inference using vLLM on ND-H100-v5
Introduction The pace of development in large language models (LLMs) has continued to accelerate as the global AI community races toward the goal of artificial general intelligence (AGI). Today’s most advanced models boast trillions of parameters, pushing the boundaries of what machines can understand and generate. However, this scale comes…
You may be interested in
Accelerating NAMD on Azure HB-series VMs
Authors: Amirreza Rastegari, Nihit Pokhrel, Nathan Baker, Jon Shelley Introduction: Nanoscale Molecular Dynamics (NAMD) is a molecular dynamics program designed for high-performance simulation of large biomolecular systems. The program…22/03/2023Creating a Slurm Job Submission App in Open OnDemand with Copilot Agent
High Performance Computing (HPC) environments are essential for research, engineering, and data-intensive workloads. To efficiently manage compute resources and job submissions, organizations rely on robust scheduling and orchestration tools. In…21/07/2025HPC on Redhat Linux images
While working with enterprise HPC teams, one of the often-heard questions is: how do we use InfiniBand or GPUs on Azure with Redhat Linux? Since Redhat does not provide hpc-enabled…17/06/2025Microsoft showcases latest AI solutions at NVIDIA GTC
It was great to see you at the NVIDIA GTC AI Conference in San Jose, CA March 18 - 21! We hope the Microsoft Azure AI infrastructure demos and sessions…28/03/2024A Quick Guide to Benchmarking AI models on Azure: Llama 405B and 70B with MLPerf Inference v5.1
by Mark Gitau (Software Engineer) Introduction For the MLPerf Inference v5.1 submission, Azure shared performance results on the new ND GB200 v6 virtual machines. A single ND GB200 v6 VM…09/09/2025Monitoring HPC & AI Workloads on Azure H/N VMs Using Telegraf and Azure Monitor (GPU & InfiniBand)
As HPC & AI workloads continue to scale in complexity and performance demands, ensuring visibility into the underlying infrastructure becomes critical. This guide presents an essential monitoring solution for AI…24/04/2025Deploying ZFS Scratch Storage for NVMe on Azure Kubernetes Service (AKS)
Introduction This guide demonstrates how to use ZFS LocalPV to efficiently manage the NVMe storage available on several Azure HPC/AI VM types in the H-series and N-series family. For example,…08/01/2025Running DeepSeek on AKS with Ollama
Introduction This guide provides step-by-step instructions on how to run DeepSeek on Azure Kubernetes Service (AKS). The setup utilizes an ND-H100-v5 VM to accommodate the 4-bit quantized 671-billion parameter model on a…31/01/2025Az-HOP in the Azure Marketplace
Az-HOP in the Azure Marketplace Introduction Azure HPC On-Demand Platform, or Az-HOP, provides an end-to-end deployment mechanism for a base HPC infrastructure on Azure. The platform includes a…24/05/2023Azure Managed Lustre: not your grandparents’ parallel file system
Lustre has long been the gold standard for extreme performance and scalability amongst parallel file systems used in HPC. The open-source community has continually improved Lustre features and performance to…03/08/2023Microsoft at SC23
Come visit Microsoft at Supercomputing 2023 (SC23) November 12 – 17 where we’ll deep dive into high-performance computing (HPC) and AI solutions during an exciting week of sessions, hands on experiences and…27/10/2023