Overview
Explore a secure reference architecture for a fully productionized platform integrating Data Factory, Databricks, Data Lake, and Azure Synapse in this 51-minute conference talk. Learn about security options and potential pitfalls while designing data architectures that meet InfoSec approval. Discover the impact of various components, foundational elements, private endpoints, Databricks VNET peering and injection, Data Factory on-premises connectivity, and Azure Synapse considerations. Gain insights into essential security features and areas requiring caution in implementation. Presented by Craig Porteous, a Microsoft Data Platform MVP and Senior Data Engineer, this session offers valuable knowledge for professionals working with data and related technologies in the Azure ecosystem.
Syllabus
Intro
THE DATA PLATFORM
WHAT'S THE IMPACT
THE FOUNDATIONS
PRIVATE ENDPOINTS
DATABRICKS VNET PEERING
DATABRICKS VNET INJECTION
DATA FACTORY ON-PREMISES CONNECTIVITY
WHAT ABOUT AZURE SYNAPSE?
SUMMARY
SECURITY FEATURES
USE WITH CAUTION
Taught by
SQLBits