Analytics

Azure Data Explorer now supports ingestion of data from many receivers via the OpenTelemetry exporter.

Stream Analytics no-code editor enables you to develop a Stream Analytics job in minutes with drag and drop experience. Now, it is generally available with several new capabilities added.

Stream Analytics now supports end-to-end exactly once semantics when writing to Azure Data Lake Storage Gen2.

Azure Stream Analytics is a fully managed, real-time analytics service designed to help you analyze and process fast moving streams of data.

The job diagram simulator provides a capability to visualize your Stream Analytics job’s topology and help you improve the query’s parallelism as you develop your streaming query.

Azure Stream Analytics currently allows you to use user-assigned managed identities to authenticate your job's inputs and outputs.

You can use managed identity to authenticate to your Cosmos DB output from Azure Stream Analytics.

Azure Data Explorer output from Azure Stream Analytics is now generally available.

The physical job diagram provides rich, instant insights to your Stream Analytics job to help you quickly identify the causes of problems when you troubleshoot issues.

You can now configure a Stream Analytics job to write streaming data to either a new or an existing delta lake yable in Azure Data Lake Storage Gen2.

Your Stream Analytics jobs get up to 45% performance boost in CPU utilization by default.

You can now connect your Stream Analytics jobs running on a dedicated cluster to your synapse dedicated SQL pool using managed private endpoints.

Native output connector for Azure Database for PostgreSQL allows you to easily build real time applications with the database of your choice.

Authenticate your Stream Analytics jobs to connect to Service Bus using system-assigned managed identities.

New features are now available in Stream Analytics no-code editor public preview including Azure SQL database available as reference data input and output sink, diagnostic logs available for troubleshooting, and…

New Azure Data Explorer offering: the Kusto Emulator is a Docker Container encapsulating the Kusto Query Engine.

Unity Catalog is a unified and fine-grained governance solution for all data assets in your Lakehouse.

Azure Data Explorer (ADX) now supports bringing data from S3 natively without complex ETL pipelines.  

Explore four new features in the no code editor in Azure Event Hubs. This editor allows you to easily develop a Stream Analytics job without writing a single line of…

Azure Databricks, a data analytics platform optimized for the Microsoft Azure cloud services platform, is now generally available in West US 3.

Serverless SQL for Azure Databricks provides instant compute to users for their BI and SQL workloads without waiting for clusters to start up or scale out.

Reduce job failures by using elastic pool storage.

You can now configure your Azure Stream Analytics job to write to a SQL table that hasn't yet been created or see schema mismatch detection for an existing SQL table.

Azure Stream Analytics is a fully managed, real-time analytics service designed to help you analyze and process fast moving streams of data.

Add rich text formatting to asset and term descriptions in the Microsoft Purview data catalog.

Microsoft Purview data sharing for in-place data sharing for Azure Data Lake Storage (ADLS Gen2) and Azure Blob Storage is now in public preview.

Independently throttle your event streaming workloads using application groups and client applications information.

Load real-time streaming data in Azure Event Hubs to data lakes, warehouses, and other storage services in Parquet format.

Sweden Central and West Central US regions added to Azure Databricks.

Use Microsoft Purview to manage access to your SQL sources using access policies.

Autoscaling allows you to define the minimum and maximum streaming units. Stream Analytics will automatically take care of dynamically optimizing the number of streaming units needed for your workload.

See improvements to the Stream Analytics query development experience on the Azure portal to increase productivity.

Maximum size of a Stream Analytics job and a cluster is increased from 192 SUs to 396 SUs.

Stream Analytics no code editor provides a rich, no code, drag and drop experience for you to build you streaming pipeline within minutes.

Microsoft Purview Data Estate Insights (in GA July 1, 2022) provides a bird's eye view of your data estate's health.

Microsoft Purview Data Policy enables policies for data access, now including SQL dev ops roles.

Stream Analytics now supports authenticating to Azure Cosmos DB and Azure Service Bus using Managed Identities.

Azure Synapse database templates are industry-specific schema definitions that provide a standardized way for you to store and shape data, enabling rapid digital transformation.

Build reliable, maintainable, and testable data processing pipelines with Delta Live Tables.

The Azure Purview data catalog search experience now includes glossary terms in the search results. 

Enhance your security posture by leveraging Azure private endpoints to connect to your Azure Data Explorer cluster privately

We can now build an entire Azure Data Explorer environment with ARM template. Schema entities (e.g. tables, functions, policies) can be deployed without an external storage account.

Azure Stream Analytics is a fully managed, real-time analytics service designed to help you analyze and process fast moving streams of data.

Azure Data Explorer launches support for Azure Active Directory Conditional Access.

You can now use user-assigned managed identity to authenticate your Stream Analytics jobs to inputs and outputs without ever having to worry about credential management.

Dynamically route Azure Data Explorer data to an alternate database

Machine Learning user-defined function in Stream Analytics allows you to perform high throughput, low latency, real-time predictions, allowing you to act on insights which have a very short shelf-life.

You can now manage approvals for business terms or self-service data access requests for your entire data estate without having to use manual controls like emails or worksheets.

Data stewards can now certify assets that meet their organization's quality standards in the Azure Purview data catalog

The Azure Purview UX team has localized Azure Purview studio to 18 languages.