Processing Millions of Events using Databricks Delta Live Tables, Azure Event Hubs and Power BI

This post is authored by Patrick Kragthorpe-Shirley (RBA) and Frank Munz (Databricks). RBA Inc is a digital and technology consultancy and is a Microsoft Solutions Partner and Databricks Partner. More about the authors at the end of this article. As the Director of Software Engineering and Data at RBA, Patrick continues…

18/01/2024Analytics on Azure Blog

Share:

You may be interested in

Simplicity meets Power – Integrate Azure Stream Analytics with Delta Lake
Analytics on Azure Blog,
In today's data-driven world, organizations are continuously seeking innovative solutions to manage and process their ever-growing volumes of streaming data. Traditional data storage formats often struggle to keep pace with…
12/04/2024
Revolutionizing SQL Queries with Azure Open AI and Semantic Kernel
Analytics on Azure Blog,
Introduction Are you tired of manually writing SQL queries? Do you wish there was an easier way to interact with your data? Look no further! In this blog post, we…
30/08/2023
Migration Guide for HDInsight 5.1 – Hadoop cluster
Analytics on Azure Blog,
Azure HDInsight is a managed, full-spectrum, open-source analytics service in the cloud for enterprises. With HDInsight, you can use open-source frameworks such as, Apache Spark, Apache Hive, LLAP, Apache Kafka,…
27/02/2024
Revolutionizing Data Intelligence: Azure Databricks Updates
Analytics on Azure Blog,
Data Intelligence Platform in Azure Databricks is revolutionizing the Data and AI landscape. This fully managed service, which is built on Lakehouse architecture supported by Delta Lake, and is integrated with Microsoft…
22/05/2024
Apache Spark on HDInsight on AKS - Submit Spark Job
Analytics on Azure Blog,
Introduction HDInsight on AKS is on a containerized architecture, exciting enhancements for the Spark workload, adding two new open-source workloads, Trino and Flink. HDInsight on AKS delivers managed infrastructure, security,…
17/11/2023
Data Vault 2.0 Modelling in Synapse Data Warehouse on Microsoft Fabric
Analytics on Azure Blog,
This Article is Authored By Michael Olschimke, co-founder and CEO at Scalefree International GmbH and Co-authored with bschlottfeldt Bárbara Schlottfeldt Maia BI Consultant from Scalefree The Technical Review is done by Ian Clarke and Naveed Hussain – GBBs (Cloud Scale Analytics) for EMEA at…
07/12/2023
Power Up your BI with Microsoft Power BI and Lakehouse in Azure Databricks: part 2 – Tuning Power BI
Analytics on Azure Blog,
This is the second post in a 3-part blog series on Power BI with Azure Databricks SQL authored by Andrey Mirskiy and Diego Fanesi. Read Part 1: Power Up your BI with Microsoft Power BI…
12/05/2023
Enhanced Performance in Additional Regions: Azure Synapse Analytics Spark Boosted by up to 77%
Analytics on Azure Blog,
We are committed to continually advancing the capabilities of Azure Synapse Analytics Spark, and are pleased to announce substantial improvements that could increase Spark performance by as much as 77%.…
26/02/2024
Announcing public preview of Apache Flink with Azure HDInsight on AKS
Analytics on Azure Blog,
We're thrilled to introduce the public preview of Apache Flink with HDInsight on AKS. Streaming data is now pervasive in a business context and with the ability to process…
10/10/2023
Apache Kafka Cluster – TLS encryption on HDInsight
Analytics on Azure Blog,
In this blog we will go through how to set up Transport Layer Security (TLS) encryption for HDInsight Apache Kafka cluster (between Apache Kafka brokers and Apache Zookeepers). Prerequisite…
20/03/2024
Azure Command Companion
Analytics on Azure Blog,
Azure Command Companion: Harnessing the Power of OpenAI GPT-3.5 Turbo for Azure CLI Command Generation Introduction Welcome to the world of efficient and effective Azure resource management with the…
10/12/2023
Introducing Apache Flink on Azure HDInsight on AKS
Analytics on Azure Blog,
We're thrilled to introduce the public preview of Apache Flink® on Azure HDInsight on AKS Streaming data is now pervasive in a business context and with the ability to process data…
10/10/2023