Annual Roundup on AI Infrastructure Breakthroughs for 2023
What a difference a year makes! Last year I said 2022 was a banner year for AI developments… if 2022 was a banner year then how should we describe 2023?…
27/03/2024
A quick start guide to benchmarking AI models in Azure: Llama 2 from MLPerf Inference v4.0
By: Mark Gitau, Software Engineer, and Hugo Affaticati, Technical Program Manager 2 Useful resources: New NC H100 v5-series: Microsoft NC H100 v5-series Thought leadership article: Aka.ms/Blog/MLPerfInfv4 Azure results for MLPerf Inference: MLPerf Inference V4.0 Submission to GitHub: mlcommons/inference_results_v4.0 Microsoft Azure has delivered industry-leading results for AI inference workloads amongst cloud service…
You may be interested in
Deploy NDm_v4 (A100) Kubernetes Cluster
Introduction Today there is a lot of interest around generative AI, specifically training and inferencing large language models (OpenAI GPT4, DALL.E2), Git copilot, Azure OpenAI service). Training these large…03/06/2023Setting Up Slurm Cloud Bursting Using CycleCloud on Azure
Azure CycleCloud is an enterprise-friendly tool for orchestrating and managing High-Performance Computing (HPC) environments on Azure. With CycleCloud, users can provision infrastructure for HPC systems, deploy familiar HPC schedulers, and…15/05/2024A Quick Guide to Benchmarking AI Models on Azure: ResNet with MLPerf Training v3.0
By Hugo Affaticati (Technical Program Manager), Sonal Doomra (Technical Program Manager 2), and Jon Shelley (Principal TPM Manager). Introduction Azure is pleased to showcase results from our MLPerf Training…28/06/2023New Azure NC H100 v5 VMs Optimized for Generative AI and HPC workloads is now Generally Available
Azure NC H100 v5 virtual machines (VMs) are an excellent platform for executing diverse AI and High-Performance Computing (HPC) workloads. These workloads demand substantial computational power, large capacity of high-performance…18/03/2024Public Preview: Hibernation Support extended to GPU and more General Purpose VM sizes.
Azure is excited to announce that hibernation support has been extended to the following General Purpose VM sizes up to 64GB RAM-: Esv5-series Edsv5-series Easv5-series Eadsv5-series In addition, as previously announced in…29/04/2024How to unmount Azure Managed Lustre filesystem using Azure Scheduled Events
Azure Managed Lustre delivers the time-tested Lustre file system as a first-party managed service on Azure. Long-time users of Lustre on-premises can now leverage the benefits of a complete HPC solution,…04/09/2023Ramp up with me… on HPC: Understanding Virtual Machines, CPUs, and GPUs
There are a lot of different products you need to successfully complete a high-performance computing (HPC) workload. You’ll hear several terms regularly, like virtual machines, CPUs, GPUs, compute power, and…31/08/2023Create the Future at Microsoft Azure HPC + AI Infrastructure Summit with AMD.
HPC AI Infrastructure Summit Discover how Microsoft, AMD, and your peers are revolutionizing their infrastructure with HPC+AI Click Here to Register Now to Secure Your Spot! Join us for…03/05/2024Azure announces new AI optimized VM series featuring AMD’s flagship MI300X GPU
In our relentless pursuit of pushing the boundaries of artificial intelligence, we understand that cutting-edge infrastructure and expertise is needed to harness the full potential of advanced AI. At Microsoft,…15/11/2023Ramp up with me…on HPC: What is high-performance computing (HPC)?
By: Rachel Pruitt, Product Marketing Manager, Azure HPC, AI Infrastructure When I first started my role in marketing for high performance computing (HPC), I knew very little about what…12/04/2023Azure Managed Lustre: not your grandparents’ parallel file system
Lustre has long been the gold standard for extreme performance and scalability amongst parallel file systems used in HPC. The open-source community has continually improved Lustre features and performance to…03/08/2023