Collecting API Management Logs and Metrics for LLMs

Welcome to our latest tutorial on collecting API management logs and metrics for large language models (LLMs). In this video, we’ll guide you through the essential steps to monitor and analyze API performance, ensuring your LLMs are running efficiently. Whether you’re aiming to optimize your API’s responsiveness or gain insights…

12/05/2025 Video Bloggers Houssem Dellai

Share:

You may be interested in

Kubecon EU in Paris
I attended Kubecon Europe in Paris and made some interviews. Here is the final video. Follow me on Twitter for more content: https://twitter.com/houssemdellai
27/03/2024
AKS and API Management: better together
You can use an #IngressController in #AKS to securely expose your apps. But if you are required to use #Azure #API Management as a central hub to your apps, then…
18/07/2024
Limiting the number of Tokens in Azure OpenAI
This is how to count number of consumed and remaining tokens in #Azure #APIManagement. This is important to limit number of tokens per user or per application. And it is…
15/01/2025
Introduction to Azure Firewall
Learn in this video the why and how of an #Azure #Firewall. Hint: it is all about #security ! If you're interested in learning more, I invite you to join…
22/01/2024
App Routing, the best AKS feature ?
When you expose your AKS applications, you typically use ingress. With ingress, you will need to manage: 1) Private and public Ingress Controllers 2) DNS custom domain names 3) TLS…
19/04/2024
Connecting API Management to OpenAI
This is how to connect Azure API Management to an LLM model like OpenAI. This shows how to configure APIM to authenticate to the model using Identity, and how to…
14/01/2025
The Azure services that resolves DNS complications
I saw many recent architectures using this new Azure service. It solves one of the headaches for cloud architects: #DNS. I got interested in the topic. I spent long hours…
16/02/2024
Intro and demo for App Gateway with Ingress Controller for AKS
This is how you can setup App Gateway with an Ingress Controller to manage ingress traffic in AKS. This is an alternative to using AGIC. Disclaimer: This video is part…
28/07/2025
#Azure #LandingZone for #ContainerApps

02/10/2023
Getting Container Apps logs in Grafana
Grafana is very popular with Kubernetes. Does it work with anything else ? Grafana is very popular with collecting metrics. Does it work with logs ? Yes it do! You…
16/04/2024
Why Azure Load Balancer

20/11/2023
Preserving client IP address in Kubernetes
Learn how you can preserve and retrieve real client IP address in Kubernetes. This video is part of my course on Udemy: https://www.udemy.com/course/learn-aks-network-security Follow me on Twitter for more content:…
07/12/2024