Annual Roundup on AI Infrastructure Breakthroughs for 2023
What a difference a year makes! Last year I said 2022 was a banner year for AI developments… if 2022 was a banner year then how should we describe 2023?…
27/03/2024
HPC/AI Storage options for NDm_v4 (A100) Azure kubernetes service (AKS) cluster
Introduction In a previous blog post we showed how to deploy an optimal NDm_v4 AKS cluster, i.e. all 8 InfiniBand and GPU devices on each NDm_v4 are installed correctly. We then verified that the NDm_v4 kubernetes cluster was deployed/configured correctly by running a NCCL allreduce benchmark on 2…
You may be interested in
Az-HOP in the Azure Marketplace
Az-HOP in the Azure Marketplace Introduction Azure HPC On-Demand Platform, or Az-HOP, provides an end-to-end deployment mechanism for a base HPC infrastructure on Azure. The platform includes a…24/05/2023Setting Up Slurm Cloud Bursting Using CycleCloud on Azure
Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High-Performance Computing (HPC) environments on Azure. With CycleCloud, users can provision infrastructure for HPC systems, deploy familiar HPC schedulers, and…15/05/2024A Quick Guide to Benchmarking AI Models on Azure: ResNet with MLPerf Training v3.0
By Hugo Affaticati (Technical Program Manager), Sonal Doomra (Technical Program Manager 2), and Jon Shelley (Principal TPM Manager). Introduction Azure is pleased to showcase results from our MLPerf Training…28/06/2023Optimize GPU compute costs: Pause your VMs to save!
We're excited to announce that in April, Azure will be offering customers the ability to optimize GPU compute costs by enabling hibernation on Virtual Machines (VMs). With this feature,…18/03/2024Public Preview: Hibernation Support extended to GPU and more General Purpose VM sizes.
Azure is excited to announce that hibernation support has been extended to the following General Purpose VM sizes up to 64GB RAM-: Esv5-series Edsv5-series Easv5-series Eadsv5-series In addition, as previously announced in…29/04/2024How to unmount Azure Managed Lustre filesystem using Azure Scheduled Events
Azure Managed Lustre delivers the time-tested Lustre file system as a first-party managed service on Azure. Long-time users of Lustre on-premises can now leverage the benefits of a complete HPC solution,…04/09/2023Ramp up with me… on HPC: Understanding Virtual Machines, CPUs, and GPUs
There are a lot of different products you need to successfully complete a high-performance computing (HPC) workload. You’ll hear several terms regularly, like virtual machines, CPUs, GPUs, compute power, and…31/08/2023Create the Future at Microsoft Azure HPC + AI Infrastructure Summit with AMD.
HPC AI Infrastructure Summit Discover how Microsoft, AMD, and your peers are revolutionizing their infrastructure with HPC+AI Click Here to Register Now to Secure Your Spot! Join us for…03/05/2024Azure Managed Lustre with Automatic Synchronisation to Azure BLOB Storage
Introduction This blog post walks through how to setup an Azure Managed Lustre Filesystem (AMLFS) that will automatically synchronise to an Azure BLOB Storage container. The synchronisation is achieved using the Lustre…30/11/2023Saying Goodbye to HPC Pack 2012 R2: End of Life Date Reached April 11th 2023
Introduction: Microsoft announced many years ago that it will end support for its High-Performance Computing (HPC) Pack 2012 R2 on April 11th, 2023. This means that Microsoft will no longer…11/04/2023Azure Managed Lustre: not your grandparents’ parallel file system
Lustre has long been the gold standard for extreme performance and scalability amongst parallel file systems used in HPC. The open-source community has continually improved Lustre features and performance to…03/08/2023