Introducing the new Azure AI infrastructure VM series ND MI300X v5

Industry-leading high-bandwidth memory (HBM) capacity and bandwidth targeting generative inferencing and AI training Artificial intelligence is transforming every industry and creating new opportunities for innovation and growth. On top of this, AI models are continually advancing and becoming more complex and accurate. More powerful computers with purpose-built AI accelerators…

21/05/2024Azure High Performance Computing (HPC) Blog

Share:

You may be interested in

A quick start guide to benchmarking AI models in Azure: Llama 2 from MLPerf Inference v4.0
Azure High Performance Computing (HPC) Blog,
By: Mark Gitau, Software Engineer, and Hugo Affaticati, Technical Program Manager 2   Useful resources: New NC H100 v5-series: Microsoft NC H100 v5-series Thought leadership article: Aka.ms/Blog/MLPerfInfv4 Azure results for MLPerf Inference: MLPerf…
27/03/2024
Deploy NDm_v4 (A100) Kubernetes Cluster
Azure High Performance Computing (HPC) Blog,
Introduction Today there is a lot of interest around generative AI, specifically training and inferencing large language models (OpenAI GPT4, DALL.E2), Git copilot, Azure OpenAI service). Training these large…
03/06/2023
Deploying Open OnDemand Portal with Azure CycleCloud
Azure High Performance Computing (HPC) Blog,
Dr. Wolfgang De Salvador - EMEA GBB HPC/AI Infrastructure Senior Specialist Dr. Darko Mocelj - EMEA GBB HPC/AI Infrastructure Senior Specialist Resources and references used in this article: Repository…
09/05/2024
A Quick Guide to Benchmarking AI Models on Azure: ResNet with MLPerf Training v3.0
Azure High Performance Computing (HPC) Blog,
By Hugo Affaticati (Technical Program Manager), Sonal Doomra (Technical Program Manager 2), and Jon Shelley (Principal TPM Manager). Introduction Azure is pleased to showcase results from our MLPerf Training…
28/06/2023
New Azure NC H100 v5 VMs Optimized for Generative AI and HPC workloads is now Generally Available
Azure High Performance Computing (HPC) Blog,
Azure NC H100 v5 virtual machines (VMs) are an excellent platform for executing diverse AI and High-Performance Computing (HPC) workloads. These workloads demand substantial computational power, large capacity of high-performance…
18/03/2024
Annual Roundup of AI Infrastructure Breakthroughs for 2023
Azure High Performance Computing (HPC) Blog,
What a difference a year makes! Last year I said 2022 was a banner year for AI developments… if 2022 was a banner year then how should we describe 2023?…
27/03/2024
How to unmount Azure Managed Lustre filesystem using Azure Scheduled Events
Azure High Performance Computing (HPC) Blog,
Azure Managed Lustre delivers the time-tested Lustre file system as a first-party managed service on Azure. Long-time users of Lustre on-premises can now leverage the benefits of a complete HPC solution,…
04/09/2023
Ramp up with me… on HPC: Understanding Virtual Machines, CPUs, and GPUs
Azure High Performance Computing (HPC) Blog,
There are a lot of different products you need to successfully complete a high-performance computing (HPC) workload. You’ll hear several terms regularly, like virtual machines, CPUs, GPUs, compute power, and…
31/08/2023
Public Preview: Hibernation Support extended to GPU and more General Purpose VM sizes.
Azure High Performance Computing (HPC) Blog,
Azure is excited to announce that hibernation support has been extended to the following General Purpose VM sizes up to 64GB RAM-: Esv5-series Edsv5-series Easv5-series Eadsv5-series In addition, as previously announced in…
29/04/2024
Azure announces new AI optimized VM series featuring AMD’s flagship MI300X GPU
Azure High Performance Computing (HPC) Blog,
In our relentless pursuit of pushing the boundaries of artificial intelligence, we understand that cutting-edge infrastructure and expertise is needed to harness the full potential of advanced AI. At Microsoft,…
15/11/2023
Ramp up with me…on HPC: What is high-performance computing (HPC)?
Azure High Performance Computing (HPC) Blog,
By: Rachel Pruitt, Product Marketing Manager, Azure HPC, AI Infrastructure When I first started my role in marketing for high performance computing (HPC), I knew very little about what…
12/04/2023
Azure Managed Lustre: not your grandparents’ parallel file system
Azure High Performance Computing (HPC) Blog,
Lustre has long been the gold standard for extreme performance and scalability amongst parallel file systems used in HPC. The open-source community has continually improved Lustre features and performance to…
03/08/2023