Running Container Workloads in CycleCloud-Slurm – Multi-Node, Multi-GPU Jobs (NCCL Benchmark)

Running high-performance computing (HPC) and AI workloads in the cloud requires a flexible and scalable orchestration platform. Microsoft Azure CycleCloud, when combined with Slurm, provides an efficient solution for managing containerized applications across HPC clusters. In this blog, we will explore how to run multi-node, multi-GPU workloads in a CycleCloud-Slurm…

02/04/2025Azure High Performance Computing (HPC) Blog

Share:

You may be interested in

Bringing Generative AI to Semiconductor and Electronics Design
Azure High Performance Computing (HPC) Blog,
Generative AI promises to revolutionize how we live, work and play. This, as with prior technology innovations, have all been developed on increasingly complex, high-performance semiconductor platforms and systems. As…
15/11/2023
Accelerating NAMD on Azure HB-series VMs
Azure High Performance Computing (HPC) Blog,
Authors: Amirreza Rastegari, Nihit Pokhrel, Nathan Baker, Jon Shelley Introduction: Nanoscale Molecular Dynamics (NAMD) is a molecular dynamics program designed for high-performance simulation of large biomolecular systems. The program…
22/03/2023
A quick start guide to benchmarking AI models in Azure: Llama 2 from MLPerf Inference v4.0
Azure High Performance Computing (HPC) Blog,
By: Mark Gitau, Software Engineer, and Hugo Affaticati, Technical Program Manager 2   Useful resources: New NC H100 v5-series: Microsoft NC H100 v5-series Thought leadership article: Aka.ms/Blog/MLPerfInfv4 Azure results for MLPerf Inference: MLPerf…
27/03/2024
Announcing the AI Infrastructure on Azure repository
Azure High Performance Computing (HPC) Blog,
Authors Davide Vanzo - Senior Technical Program Manager - Azure Specialized Jer-Ming Chia - Principal Technical Program Manager - Azure Specialized Jesse Lopez - Senior Technical Program Manager - Azure…
28/05/2025
Migrating existing HPC workloads from Azure Cyclecloud to Azure Batch
Azure High Performance Computing (HPC) Blog,
Understanding Azure Batch for HPC Azure Batch is a cloud-based service provided by Microsoft Azure that's designed to handle HPC workloads efficiently. It's known for its simplicity and versatility,…
16/10/2023
Training large AI models on Azure using CycleCloud + Slurm
Azure High Performance Computing (HPC) Blog,
Training large AI models on Azure using CycleCloud + Slurm In the past year generative AI models have leapt into common discourse through the popularity of text-to-image models and…
28/03/2023
Teamcenter Simulation Process Data Management Architecture on Azure CycleCloud- Slurm cluster
Azure High Performance Computing (HPC) Blog,
Introduction: Many customers run multiple Teamcenter-SPDM solutions across the enterprise, mixing multiple instances, multiple ISV vendors, and hybrid cloud/on-prem implementations. This fragmentation reduces the customer’s ability to uniformly access data.…
28/08/2025
Azure previews ND MI300X v5 optimized for demanding AI and HPC workloads
Azure High Performance Computing (HPC) Blog,
Last month we first announced ND MI300X v5 virtual machines (VMs) and talked about how they were the culmination of a long-term partnership between Microsoft and AMD. We also talked about…
06/12/2023
Scaling Up in the Cloud: The WEKA Data Platform and Azure HPC Windows Grid Integration
Azure High Performance Computing (HPC) Blog,
Co-Written with Erik Garcia, WEKA Director of Cloud Sales, Brian Markenson, WEKA System Engineer, & Adam Fowler, WEKA System Engineer High Performance Compute (HPC) grids in the Financial Services Industry are unique…
28/02/2024
Deploy NDm_v4 (A100) Kubernetes Cluster
Azure High Performance Computing (HPC) Blog,
Introduction Today there is a lot of interest around generative AI, specifically training and inferencing large language models (OpenAI GPT4, DALL.E2), Git copilot, Azure OpenAI service). Training these large…
03/06/2023
Create the future with AI: Join Microsoft at NVIDIA GTC
Azure High Performance Computing (HPC) Blog,
Calling all AI innovators, champions, and pioneers... The impact of AI on businesses is profound and Microsoft is committed to helping every company, regardless of its size, and everyone, regardless…
13/02/2025
Azure Managed Lustre with Automatic Synchronisation to Azure BLOB Storage
Azure High Performance Computing (HPC) Blog,
Introduction This blog post walks through how to setup an Azure Managed Lustre Filesystem (AMLFS) that will automatically synchronise to an Azure BLOB Storage container. The synchronisation is achieved using the Lustre…
30/11/2023