The importance of streaming for LLM-powered chat applications

Thanks to the popularity of chat-based interfaces like ChatGPT and GitHub Copilot, users have grown accustomed to getting answers conversationally. As a result, thousands of developers are now deploying chat applications on Azure for their own specialized domains. To help developers understand how to build LLM-powered chat apps, we have…

07/10/2025Azure Developer Community Blog

Share:

You may be interested in

Mastering Query Fields in Azure AI Document Intelligence with C#
Azure Developer Community Blog,
Introduction Azure AI Document Intelligence simplifies document data extraction, with features like query fields enabling targeted data retrieval. However, using these features with the C# SDK can be tricky. This…
14/05/2025
Running Azurite in a Dev Container:
Azure Developer Community Blog,
I'm Pamela, a member of the Python cloud advocacy team. As part of my role, I contribute to open-source projects that are popular with the Python community, like extensions for…
03/12/2024
¡GitHub Copilot gratis! Ahora al alcance de todos
Azure Developer Community Blog,
Ahora todos pueden usar GitHub Copilot GRATIS en Visual Studio Code. Sólo necesitas tu cuenta de GitHub. Sin periodos de pruebas, sin tarjeta de crédito. Comienza con GitHub Copilot hoy,…
18/12/2024
Building Intelligent Apps with Azure Cache for Redis, EntraID, Azure Functions, E1 SKU, and more!
Azure Developer Community Blog,
We're excited to announce the latest updates to Azure Cache for Redis that will improve your data management and application performance as we kickoff for Microsoft Build 2024. Coming…
21/05/2024
Securing your AI Apps on Azure: Recordings and Slides!
Azure Developer Community Blog,
In July, we put on a 6-part live stream series all about securing your AI apps on Azure, covering topics like keyless authentication, user login with Microsoft Entra, RAG data…
26/08/2024
Programming with GitHub Copilot Agent Mode
Azure Developer Community Blog,
GitHub Copilot continues to grow, starting with code completion/generation/optimization, to GitHub Copilot Chat, which optimizes the quality of AI-generated code through chat interaction, to GitHub Copilot Edit Model, which can…
04/04/2025
Scale AI solutions through app modernization and targeted skilling
Azure Developer Community Blog,
As industries embrace the era of AI, legacy apps and data infrastructure often prevent organizations from harnessing its benefits; to drive innovation and maintain a competitive edge, companies must modernize…
02/12/2024
Azure Custom Policy- PostgreSQL Product – Compliance Report not Available- New Feature Request
Azure Developer Community Blog,
If you try to create custom policy to add diagnostic settings for Azure Cosmos DB for PostgreSQL Cluster for log analytics and assign policy at subscription level, you will find…
17/05/2024
Manage your LLM token spend
Azure Developer Community Blog,
This article is part of a series of articles on API Management and Generative AI. We firmly believe that adding Azure API Management to your AI projects can help you…
25/03/2025
Extending Copilot for Microsoft 365 using TypeScript | Azure Developers JavaScript Day 2024
Azure Developer Community Blog,
In this fourth artile around the Microsoft event: the Azure Developers JavaScript Day 2024, Bob German, Principal Cloud Advocate in M365 at Microsoft, showcased the possibilities of extending Copilot within…
21/04/2024
Azure Managed Redis (Preview): The Next Generation of Redis on Azure at Microsoft Ignite 2024
Azure Developer Community Blog,
We were excited to announce the preview of Azure Managed Redis at Microsoft Ignite 2024, a first party, in-memory database solution designed for developers building the next generation of GenAI…
28/11/2024
Quest – I want to move my AI prototype to Azure
Azure Developer Community Blog,
In this quest, you’ll take your locally running Gen AI app and deploy it to the cloud using Azure. You’ll use the move from GitHub Models to Azure AI Foundry…
11/06/2025