Apache Spark on HDInsight on AKS - Submit Spark Job

Introduction HDInsight on AKS is on a containerized architecture, exciting enhancements for the Spark workload, adding two new open-source workloads, Trino and Flink. HDInsight on AKS delivers managed infrastructure, security, and monitoring so that teams can spend their time building innovative applications without needing to worry about the other components…

17/11/2023Analytics on Azure Blog

Share:

You may be interested in

Simplicity meets Power – Integrate Azure Stream Analytics with Delta Lake
Analytics on Azure Blog,
In today's data-driven world, organizations are continuously seeking innovative solutions to manage and process their ever-growing volumes of streaming data. Traditional data storage formats often struggle to keep pace with…
12/04/2024
Revolutionizing SQL Queries with Azure Open AI and Semantic Kernel
Analytics on Azure Blog,
Introduction Are you tired of manually writing SQL queries? Do you wish there was an easier way to interact with your data? Look no further! In this blog post, we…
30/08/2023
Migration Guide for HDInsight 5.1 – Hadoop cluster
Analytics on Azure Blog,
Azure HDInsight is a managed, full-spectrum, open-source analytics service in the cloud for enterprises. With HDInsight, you can use open-source frameworks such as, Apache Spark, Apache Hive, LLAP, Apache Kafka,…
27/02/2024
Revolutionizing Data Intelligence: Azure Databricks Updates
Analytics on Azure Blog,
Data Intelligence Platform in Azure Databricks is revolutionizing the Data and AI landscape. This fully managed service, which is built on Lakehouse architecture supported by Delta Lake, and is integrated with Microsoft…
22/05/2024
Submit Apache Spark and Apache Flink jobs with Azure Logic Apps on HDInsight on AKS
Analytics on Azure Blog,
Author(s): Arun Sethia is a Program manager in Azure HDInsight Customer Success Engineering (CSE) team. Co-Author: Sairam is a Product manager for Azure HDInsight on AKS. Introduction Azure Logic…
22/11/2023
Processing Millions of Events using Databricks Delta Live Tables, Azure Event Hubs and Power BI
Analytics on Azure Blog,
This post is authored by Patrick Kragthorpe-Shirley (RBA) and Frank Munz (Databricks). RBA Inc is a digital and technology consultancy and is a Microsoft Solutions Partner and Databricks Partner. More about the…
18/01/2024
Power Up your BI with Microsoft Power BI and Lakehouse in Azure Databricks: part 2 – Tuning Power BI
Analytics on Azure Blog,
This is the second post in a 3-part blog series on Power BI with Azure Databricks SQL authored by Andrey Mirskiy and Diego Fanesi. Read Part 1: Power Up your BI with Microsoft Power BI…
12/05/2023
Enhanced Performance in Additional Regions: Azure Synapse Analytics Spark Boosted by up to 77%
Analytics on Azure Blog,
We are committed to continually advancing the capabilities of Azure Synapse Analytics Spark, and are pleased to announce substantial improvements that could increase Spark performance by as much as 77%.…
26/02/2024
Announcing public preview of Apache Flink with Azure HDInsight on AKS
Analytics on Azure Blog,
We're thrilled to introduce the public preview of Apache Flink with HDInsight on AKS. Streaming data is now pervasive in a business context and with the ability to process…
10/10/2023
Apache Kafka Cluster – TLS encryption on HDInsight
Analytics on Azure Blog,
In this blog we will go through how to set up Transport Layer Security (TLS) encryption for HDInsight Apache Kafka cluster (between Apache Kafka brokers and Apache Zookeepers). Prerequisite…
20/03/2024
Rediscover your data’s value by skilling up on Microsoft Fabric
Analytics on Azure Blog,
Every day, businesses probe vast data oceans to extract pearls of insight from the depths. This can be a challenging task depending on the complexity of the data, a…
12/12/2023
Introducing Apache Flink on Azure HDInsight on AKS
Analytics on Azure Blog,
We're thrilled to introduce the public preview of Apache Flink® on Azure HDInsight on AKS Streaming data is now pervasive in a business context and with the ability to process data…
10/10/2023