Enhanced autoscale capabilities in HDInsight clusters

Today, we announce HDInsight Autoscale with enhanced capabilities which include improved latency and support for recommissioning node managers in case of load-based autoscale. Together, they improve cluster utilization massively and lower the total cost of ownership (TCO) significantly. Additionally, we also introduce customizable parameters on Autoscale to meet customer needs…

10/05/2023Analytics on Azure Blog

Share:

You may be interested in

Maximizing Efficiency with Managed Apache Flink on Azure HDInsight on AKS
Analytics on Azure Blog,
Author: Alexandre Gattiker, Principal Engineer, Industry Solutions, Microsoft.  Apache Flink, the open-source stream processing framework, has been making waves in the world of big data and real-time analytics. In October 2023,…
16/11/2023
Apache Kafka Cluster – TLS encryption on HDInsight
Analytics on Azure Blog,
In this blog we will go through how to set up Transport Layer Security (TLS) encryption for HDInsight Apache Kafka cluster (between Apache Kafka brokers and Apache Zookeepers). Prerequisite…
20/03/2024
Run your Azure Stream Analytics job inside your Azure Virtual Network (Public Preview)
Analytics on Azure Blog,
Overview Virtual network support enables you to lock down access to Azure Stream Analytics to your virtual network infrastructure. This capability provides you with the benefits of network isolation and…
23/05/2023
Rediscover your data’s value by skilling up on Microsoft Fabric
Analytics on Azure Blog,
Every day, businesses probe vast data oceans to extract pearls of insight from the depths. This can be a challenging task depending on the complexity of the data, a…
12/12/2023
Realize Lakehouse using best of breed of Open source using HDInsight
Analytics on Azure Blog,
Author: Reems Thomas Kottackal, Product Manager HDInsight on AKS is a modern, reliable, secure, and fully managed Platform as a Service (PaaS) that runs on Azure Kubernetes Service (AKS).…
10/10/2023
Enhanced Performance in Additional Regions: Azure Synapse Analytics Spark Boosted by up to 77%
Analytics on Azure Blog,
We are committed to continually advancing the capabilities of Azure Synapse Analytics Spark, and are pleased to announce substantial improvements that could increase Spark performance by as much as 77%.…
14/11/2023
Data Vault 2.0 on Azure
Analytics on Azure Blog,
This Article is Authored By Michael Olschimke, co-founder and CEO at Scalefree International GmbH and Co-authored with @mwinkelmann from Scalefree The Technical Review is done by Ian Clarke and Naveed Hussain – GBBs (Cloud Scale Analytics) for EMEA at Microsoft Introduction In…
30/06/2023
Private Preview of Kafka Input and Output with Azure Stream Analytics
Analytics on Azure Blog,
Imagine getting real-time insights into customer transactions with sub-second latency to respond to customer behavior immediately, detecting anomalies associated with your machines running at your business, or building real-time dashboards…
23/05/2023
Master Stream Analytics with the Physical Job Diagram
Analytics on Azure Blog,
To ensure that your Azure Stream Analytics (ASA) jobs are running at peak performance, it's important to have a deep understanding of your job's execution plan and closely monitor the…
19/06/2023
Securing Azure HDInsight: ESM Support with Ubuntu 18.04, Cluster Updates, and Best Practices
Analytics on Azure Blog,
Azure HDInsight, Microsoft's cloud-based big data analytics platform, continues to advance its features to provide users with a secure and efficient environment. In this article, we will explore the latest…
27/02/2024
Processing Millions of Events using Databricks Delta Live Tables, Azure Event Hubs and Power BI
Analytics on Azure Blog,
This post is authored by Patrick Kragthorpe-Shirley (RBA) and Frank Munz (Databricks). RBA Inc is a digital and technology consultancy and is a Microsoft Solutions Partner and Databricks Partner. More about the…
18/01/2024
Public Preview: Protocol Buffers (Protobuf) with Azure Stream Analytics
Analytics on Azure Blog,
Azure Stream Analytics now allows you to seamlessly process events in the Protobuf data format using a built-in Protocol Buffer deserializer. What is Protobuf? Protobuf is Google’s language-neutral, platform-neutral,…
16/11/2023