Training large AI models on Azure using CycleCloud + Slurm

Training large AI models on Azure using CycleCloud + Slurm In the past year generative AI models have leapt into common discourse through the popularity of text-to-image models and services such as DALL-E and Stable Diffusion, but especially through the explosion in knowledge and use of chatbots like ChatGPT…

28/03/2023Azure High Performance Computing (HPC) Blog

Share:

You may be interested in

CycleCloud 8.5 Release Announcement
Azure High Performance Computing (HPC) Blog,
Overview Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High Performance Computing (HPC) environments on Azure. With CycleCloud, users can provision infrastructure for HPC systems, deploy familiar…
11/11/2023
Az-HOP in the Azure Marketplace
Azure High Performance Computing (HPC) Blog,
Az-HOP in the Azure Marketplace Introduction Azure HPC On-Demand Platform, or Az-HOP, provides an end-to-end deployment mechanism for a base HPC infrastructure on Azure. The platform includes a…
24/05/2023
Setting Up Slurm Cloud Bursting Using CycleCloud on Azure
Azure High Performance Computing (HPC) Blog,
Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High-Performance Computing (HPC) environments on Azure. With CycleCloud, users can provision infrastructure for HPC systems, deploy familiar HPC schedulers, and…
15/05/2024
Running OpenFOAM simulations on Azure Batch
Azure High Performance Computing (HPC) Blog,
OpenFOAM (Open Field Operation and Manipulation) is an open-source computational fluid dynamics (CFD) software package. It provides a comprehensive set of tools for simulating and analyzing complex fluid flow and…
12/05/2023
Accelerating NAMD on Azure HB-series VMs
Azure High Performance Computing (HPC) Blog,
Authors: Amirreza Rastegari, Nihit Pokhrel, Nathan Baker, Jon Shelley Introduction: Nanoscale Molecular Dynamics (NAMD) is a molecular dynamics program designed for high-performance simulation of large biomolecular systems. The program…
22/03/2023
Automated deployment of CycleCloud and SLURM using CLI
Azure High Performance Computing (HPC) Blog,
Azure CycleCloud allows the creation of resources to run High Performance Computing (HPC) applications based on widely used job schedulers such as PBS, SLURM, and LSF. Once CycleCloud is installed,…
04/10/2023
A quick start guide to benchmarking AI models in Azure: Llama 2 from MLPerf Inference v4.0
Azure High Performance Computing (HPC) Blog,
By: Mark Gitau, Software Engineer, and Hugo Affaticati, Technical Program Manager 2   Useful resources: New NC H100 v5-series: Microsoft NC H100 v5-series Thought leadership article: Aka.ms/Blog/MLPerfInfv4 Azure results for MLPerf Inference: MLPerf…
27/03/2024
Azure Managed Lustre with Automatic Synchronisation to Azure BLOB Storage
Azure High Performance Computing (HPC) Blog,
Introduction This blog post walks through how to setup an Azure Managed Lustre Filesystem (AMLFS) that will automatically synchronise to an Azure BLOB Storage container. The synchronisation is achieved using the Lustre…
30/11/2023
Unmounting Azure Managed Lustre Filesystem in a CycleCloud HPC cluster using Azure Scheduled Events.
Azure High Performance Computing (HPC) Blog,
There is a known behaviour in Lustre if a VM has the Lustre mounted and it gets evicted or deleted as part of workflow without releasing the filesystem lock. Lustre…
04/10/2023
Accessing Azure Managed Lustre from Windows through a SAMBA server
Azure High Performance Computing (HPC) Blog,
Azure Managed Lustre Lustre is an open-source parallel filesystem born for high performance computing as a research project back in 1999. Its name is the fusion of Linux and cluster,…
10/07/2023
Accelerating OpenFOAM Integration with Azure CycleCloud
Azure High Performance Computing (HPC) Blog,
OpenFOAM, which stands for Open Field Operation and Manipulation, is a free, open-source software framework primarily used for computational fluid dynamics (CFD) simulations. It provides a wide range of numerical…
13/02/2024
Annual Roundup on AI Infrastructure Breakthroughs for 2023
Azure High Performance Computing (HPC) Blog,
What a difference a year makes! Last year I said 2022 was a banner year for AI developments… if 2022 was a banner year then how should we describe 2023?…
27/03/2024