Optimize Azure OpenAI Applications with Semantic Caching

Introduction One of the ways to optimize cost and performance of Large Language Models (LLMs) is to cache the responses from LLMs, this is sometimes referred to as “semantic caching”. In this blog, we will discuss the approaches, benefits, common scenarios and key considerations for using semantic caching. What…

10/04/2024Azure Architecture Blog

Share:

You may be interested in

Scale Azure Databricks secure network access to Azure Data Lake Storage
Azure Architecture Blog,
Many organisations store their data in a centralised data lake on Azure Storage accounts. In this post we will look at a solution to scale the secure network access between…
11/12/2023
Unleashing NDI’s Video Switching and Routing Power in Microsoft Azure
Azure Architecture Blog,
The world of media and entertainment is constantly evolving, with a growing demand for high-quality video production and streaming. In this digital era, leveraging the power of cloud computing…
17/07/2023
Microsoft Fabric Co-Existing as Semantic Layer with Power BI & Snowflake
Azure Architecture Blog,
Overview Customers have modernized their data warehouse by hosting it on Snowflake (in AWS) and have chosen Power BI (in Azure) as their single reporting/analytics platform. They used to have…
04/04/2024
Managing a Distributed API Estate Efficiently with Azure API Management and Self-Hosted Gateways
Azure Architecture Blog,
Azure API Management (APIM) is a cloud-based service that enables you to create, publish and manage your APIs behind a secure, consistent façade. You can create and manage policies that…
30/05/2024
Disaster Recovery using cross-region replication with Azure NetApp Files datastores for AVS
Azure Architecture Blog,
Table of Contents Abstract Introduction Benefits Prerequisites and general recommendations Getting Started Deploy Azure VMware Solution Provision and configure Azure NetApp Files Create volume replication for Azure NetApp Files-powered datastore…
11/07/2023
Enhanced Performance and Scalability: Azure AD-joined Session Hosts with Azure NetApp Files
Azure Architecture Blog,
Table of Contents Abstract Introduction Scenario Requirements Configuration Summary Links to Additional Information Abstract In this article, you will learn how to integrate Azure Virtual Desktop (AVD) session…
01/06/2023
Leveraging OpenAI and Azure Integration Services: A Unified Approach
Azure Architecture Blog,
Challenges of Leveraging Azure OpenAI in Disparate Data Environments Azure OpenAI offers innovative capabilities that drastically transform operations, decision-making, and service delivery in various organizational settings. Leveraging AzOpenAI and Azure…
06/11/2023
Securing Azure AD B2C API Connector (Function App) without Error
Azure Architecture Blog,
I was recently working with a customer who is using Azure AD B2C API Connector to enrich tokens with claims from external sources. They are using Azure Function App as…
12/04/2024
Enrich your Data Estate with Fabric Pipelines and Azure OpenAI
Azure Architecture Blog,
The benefits of Generative AI is of huge interest for many organisations and the possibilities seem endless. One such interesting use case is the ability to leverage Azure OpenAI models…
06/03/2024
NL to SQL Architecture Alternatives
Azure Architecture Blog,
Introduction The recent advances in LLMs have created opportunities for businesses to gain new insight into their unstructured text data. A classic example of this has been using the…
14/05/2024
Enabling data clean rooms with confidential computing
Azure Architecture Blog,
For many companies, today’s data collaboration landscape offers exciting opportunities to harness valuable insights that drive market advantage. Powered by rapid data clean room adoption, enterprises across industries are moving…
03/01/2024
Armchair Architects: Value of Curiosity in Architecture
Azure Architecture Blog,
Welcome back to Armchair Architects as part of the Azure Enablement Show. We will be discussing the role of curiosity in being an Architect. Our hosts will be David Blank-Edelman…
24/05/2023