Why your LLM-powered app needs concurrency

As part of the Python advocacy team, I help maintain several open-source sample AI applications, like our popular RAG chat demo. Through that work, I’ve learned a lot about what makes LLM-powered apps feel fast, reliable, and responsive. One of the most important lessons: use an asynchronous backend framework. Concurrency is…

07/10/2025Azure Developer Community Blog

Share:

You may be interested in

Responsible AI Innovation From Principles to Practice: Developer Resources
Azure Developer Community Blog,
In the rapidly evolving world of technology, AI stands at the forefront of innovation. However, with great power comes great responsibility. As developers, we play a pivotal role in shaping…
15/07/2024
Navigating Microsoft Build for born in the cloud companies
Azure Developer Community Blog,
Microsoft Build starts May 23rd. Register now to attend virtually. Microsoft Build, the annual conference where developers can get hands on with the latest Microsoft technologies including Azure,…
22/05/2023
Microsoft at the European Cloud Summit (ECS) 2024 (Wiesbaden, Germany)
Azure Developer Community Blog,
Join in: The European Cloud 2024 | May 14-16, 2024 | European Cloud Summit What: European Cloud Summit and European Collaboration Summit – co-located in 2024 Register today |Use the MSCMTY discount code to save 15%…
22/04/2024
Using keyless authentication with Azure OpenAI
Azure Developer Community Blog,
Like many Azure APIs, the Azure OpenAI service gives developers the option to authenticate with either API keys or keyless authentication (via Entra identity). Since it's a security best practice…
12/04/2024
Join the ONNX Generative AI Runtime teams for a discussion on the newest releases
Azure Developer Community Blog,
Join Us for an Exclusive Round Table Discussion on the ONNX Generative AI Runtime! Date: 24th March 2025 Time: 8.30am PT Location: Microsoft AI Discord Community What is an AMA?…
13/03/2025
How to Install GitHub Copilot in Visual Studio
Azure Developer Community Blog,
GitHub Copilot is a coding assistant powered by Artificial Intelligence (AI), which can run in various environments and help you be more efficient in your daily coding tasks. In this…
19/03/2024
Contributor Stories: Sedat Salman
Azure Developer Community Blog,
If you’ve ever engaged with the content on the Microsoft Learn platform, it's highly likely that the material you utilized was written or co-authored by dedicated contributors. These contributors, often…
06/05/2024
Dominate your industry and boost performance using Azure AI tools and skilling
Azure Developer Community Blog,
As AI technologies continue to rapidly evolve, developers have the exciting opportunity to stay ahead by continually learning and adapting. With countless tools, frameworks, and skilling resources available, developers often…
03/10/2024
Exciting New Features for GitHub Copilot for Azure
Azure Developer Community Blog,
We've been on a roll adding new features to the private preview and we've added some of my favorites in our latest release! Building Apps for Azure 🏗 Need help starting…
04/09/2024
Quest 7: Create an AI Agent with Tools from an MCP Server
Azure Developer Community Blog,
The JS AI Build-a-thon is in full swing — and we’re turning up the power in Quest 7!If you're just joining us, this is part of an ongoing challenge to…
23/06/2025
New GitHub Copilot Global Bootcamp: Now with Virtual and In-Person Workshops!
Azure Developer Community Blog,
The GitHub Copilot Global Bootcamp started in February as a fully virtual learning journey — and it was a hit. More than 60,000 developers joined the first edition across multiple…
27/05/2025
Is your LLM-powered app providing safe answers? Evaluate it!
Azure Developer Community Blog,
When we evaluate the quality of an app, we're making sure that it provides answers that are coherent, clear, aligned to the user's needs, and in the case of many applications:…
04/03/2025