Apache Spark 2.4 and Apache Kafka 2.1 support on Azure HDInsight

Azure HDInsight now supports Apache Spark 2.4 and Apache Kafka 2.1. You can choose the Spark or the Kafka version that you want during cluster creation in the Azure portal. Both updates come with several new features, hundreds of bug fixes and improvements.

08/07/2019AnalyticsHDInsight

Share:

You may be interested in

Monitoring your Azure Data Explorer Clusters with Azure Monitor (Insights) – public preview
Analytics, Data Explorer
Azure Monitor for Azure Data Explorer (public preview) provides comprehensive monitoring of your Azure Data Explorer clusters by delivering a unified view of the performance, operations, and usage.
11/01/2021
General availability: Authenticate to Service Bus using managed identity
Analytics, Stream Analytics
Authenticate your Stream Analytics jobs to connect to Service Bus using system-assigned managed identities.
06/09/2022
Azure Databricks now available in Switzerland North
Analytics, Databricks
Azure Databricks is now available in the Swiss Azure datacenters which marks another milestone on the way to digitize Switzerland
28/10/2020
Introducing Graph Semantics in Kusto, a new way to contextualize time series data
Analytics, Synapse Analytics
Analyze networks, connected assets and more with Kusto's graph semantics extension to the Kusto Query Language (KQL). Find out how to contextualize your time series data in KQL, and how…
11/09/2023
Azure Data Factory wrangling data flows is now in preview
Analytics, Data Factory
Azure Data Factory wrangling data flows are now in preview.
04/11/2019
Power BI Embedded new workspace experience creation API
Analytics, Power BI Embedded
Use the Power BI REST API to create new Power BI Embedded workspace experience automatically.
18/12/2018
Continued region expansion: Azure Data Factory just became generally available in two more regions
Analytics, Data Factory
Azure Data Factory is now available in two new regions: Norway East and UAE North
02/04/2021
Security Advisory: Patching Azure HDInsight clusters to address Linux Kernel TCP vulnerabilities
Analytics, HDInsight
Azure HDInsight has updated against the vulnerabilities that affect the Linux kernel.
26/06/2019
Enhanced autoscale capabilities added to HDInsight clusters
Analytics, HDInsight
Azure HDInsight has made notable improvements in stability and latency on Autoscale.
13/06/2023
General availability: Event Hubs for Python
Analytics, Event Hubs
Version 1.0 of the Python package for Azure Event Hubs is now generally available.
04/09/2018
Event Hubs resource GUID changes
Analytics, Event Hubs
On May 1, 2019, the global region resource GUIDs for Event Hubs will break out into new US Government region resource GUIDs.
27/03/2019
High throughput output from Azure Stream Analytics to Azure Synapse Analytics in preview
Analytics, Synapse Analytics
Azure Stream Analytics jobs now have the ability to output to an existing SQL pool table in Azure Synapse Analytics, and to process throughput rates up to 200 Mbps.
19/05/2020