Scale Azure Databricks secure network access to Azure Data Lake Storage

Many organisations store their data in a centralised data lake on Azure Storage accounts. In this post we will look at a solution to scale the secure network access between the centralised data lake storage account and Azure Databricks workspaces VNets. Architecture diagram of having storage account with Private Endpoint…

11/12/2023Azure Architecture Blog

Share:

You may be interested in

Keep your Azure optimization on the right track with Azure patterns and practices
Azure Architecture Blog,
Businesses are at a pivotal juncture in their cloud migration journeys, as the question is no longer “Should we do this?”, but “What’s the best way to do this?”…
13/12/2023
Unleashing NDI’s Video Switching and Routing Power in Microsoft Azure
Azure Architecture Blog,
The world of media and entertainment is constantly evolving, with a growing demand for high-quality video production and streaming. In this digital era, leveraging the power of cloud computing…
17/07/2023
Armchair Architects: Are AI Charters Valuable?
Azure Architecture Blog,
In this blog, our host, David Blank-Edelman and our armchair architects Uli Homann and Eric Charran will be delving into the significance of establishing an AI charter for organizations venturing into…
05/04/2024
Managing a Distributed API Estate Efficiently with Azure API Management and Self-Hosted Gateways
Azure Architecture Blog,
Azure API Management (APIM) is a cloud-based service that enables you to create, publish and manage your APIs behind a secure, consistent façade. You can create and manage policies that…
30/05/2024
Disaster Recovery using cross-region replication with Azure NetApp Files datastores for AVS
Azure Architecture Blog,
Table of Contents Abstract Introduction Benefits Prerequisites and general recommendations Getting Started Deploy Azure VMware Solution Provision and configure Azure NetApp Files Create volume replication for Azure NetApp Files-powered datastore…
11/07/2023
Enhanced Performance and Scalability: Azure AD-joined Session Hosts with Azure NetApp Files
Azure Architecture Blog,
Table of Contents Abstract Introduction Scenario Requirements Configuration Summary Links to Additional Information Abstract In this article, you will learn how to integrate Azure Virtual Desktop (AVD) session…
01/06/2023
Leveraging OpenAI and Azure Integration Services: A Unified Approach
Azure Architecture Blog,
Challenges of Leveraging Azure OpenAI in Disparate Data Environments Azure OpenAI offers innovative capabilities that drastically transform operations, decision-making, and service delivery in various organizational settings. Leveraging AzOpenAI and Azure…
06/11/2023
Securing Azure AD B2C API Connector (Function App) without Error
Azure Architecture Blog,
I was recently working with a customer who is using Azure AD B2C API Connector to enrich tokens with claims from external sources. They are using Azure Function App as…
12/04/2024
A Reference Architecture for Siemens and Microsoft Customers in the Industrial AI Space.
Azure Architecture Blog,
This article presents a reference architecture to enhance the compatibility of Siemens Industrial Artificial Intelligence (Industrial AI) products with Azure. The reference architecture ensures that data from Siemens edge…
07/03/2024
NL to SQL Architecture Alternatives
Azure Architecture Blog,
Introduction The recent advances in LLMs have created opportunities for businesses to gain new insight into their unstructured text data. A classic example of this has been using the…
14/05/2024
Compliant collaborations in the media industry
Azure Architecture Blog,
This article presents a solution for sensitive data collaboration between publishers, advertisers and AdTech players in a secure and privacy-compliant way using Data Clean Rooms powered by Confidential Computing. …
03/01/2024
Armchair Architects: Value of Curiosity in Architecture
Azure Architecture Blog,
Welcome back to Armchair Architects as part of the Azure Enablement Show. We will be discussing the role of curiosity in being an Architect. Our hosts will be David Blank-Edelman…
24/05/2023