Deploy LiteLLM on Microsoft Azure with AZD, Azure Container Apps and PostgreSQL

Generative AI is evolving rapidly, and developers are increasingly looking for efficient ways to manage multiple LLMs (Large Language Models) using a centralized proxy. LiteLLM is a powerful solution that simplifies multi-LLM management by acting as a proxy server. However, setting it up on Microsoft Azure can be challenging due…

14/03/2025 Article Bloggers Chris Pietschmann

Share:

You may be interested in

AISecOps: Applying DevSecOps to AI and ML Security
Artificial Intelligence (AI) and Machine Learning (ML) have emerged as transformative technologies, driving innovation across many industries. However, in addition to their benefits, AI and ML systems bring unique security…
22/04/2024
Terraform vs OpenTofu: What’s the difference?
What’s the difference between HashiCorp’s Terraform and OpenTofu? This is a tale that starts with HashiCorp first developing Terraform, the popular open source, multi-cloud, Infrastructure as Code (IaC) tool, and…
07/08/2024
Difference Between Completions and Embeddings in AI Models
Artificial Intelligence (AI) models have rapidly evolved to perform various tasks ranging from text generation to natural language understanding. Among the different types of AI-driven models, Completions and Embeddings serve…
06/02/2025
NoSQL vs SQL: Demystifying NoSQL Databases
There’s a lot of talk about NoSQL being the database of the future. Let’s take a look at NoSQL vs SQL databases, and what the differences are, use cases, and…
05/02/2024
GitHub Copilot Chat – AI Coding Assistant Anywhere in the GitHub Mobile App
GitHub Copilot Chat is a chat interface that let’s you interact directly with GitHub Copilot from within the GitHub Mobile app. It empowers developers to ask and receive answers using…
07/05/2024
Configure Azure Developer CLI (azd) for HashiCorp Terraform Infrastructure Deployment
The Azure Developer CLI (azd) is a powerful tool for accelerating application deployment to Microsoft Azure. While azd defaults to Azure Bicep for Infrastructure as Code (IaC) deployment, you can…
19/02/2025
Fix: response_type ‘id_token’ is not enabled for the application (AADSTS700054)
When creating and configuring an Azure AD App Registration to use for authenticating a web application with Azure AD, it’s common to see the AADSTS700054: response_type 'id_token' is not enabled…
17/11/2023
What is Kubernetes?
Kubernetes is an open-source platform designed to manage, automate, and scale containerized applications efficiently. It has become the go-to solution for orchestrating containers in cloud environments. If you’ve ever wondered…
03/02/2025
What is a Cloud Engineer and How to Become one?
It was once a new concept that enterprises were trying to make sense of, but the term “cloud” has really become ubiquitous across the IT landscape. No matter the industry,…
28/04/2024
GitHub Actions: Download File and Commit to Repository
A few times I’ve found the need to setup a GitHub Actions workflow that downloads a file and commits that file back to the repository. I had a need to…
03/06/2024
Introducing AIChatUI: Open Source AI Chat Sample with Azure OpenAI Service & GPT-3 / GPT-4
Since I’ve been working with Azure OpenAI Service from a developer perspective as well, I’ve decided to build a sample application to help demonstrate not just the IaC deployment of…
30/04/2024
Terraform: How to work with JSON (jsondecode, jsonencode, .tfvars.json)
HashiCorp Terraform provides a couple functions for working with JSON. These are the jsonencode and jsondecode functions and they grant the ability to encode and decode JSON. This can be…
01/11/2023