-
Book Overview & Buying
-
Table Of Contents
Data Engineering with Azure Databricks
By :
In the preceding chapters, we built a complete data engineering platform on Azure Databricks: ingesting data, transforming it through medallion layers, automating pipelines, and optimizing performance. But a well-architected data platform is only as valuable as the trust stakeholders place in it. That trust depends on securing data against unauthorized access, meeting regulatory obligations, and maintaining transparent governance over every data asset.
In Chapter 2, Setting Up an End-to-End Azure Databricks Environment, we established the foundational elements of Unity Catalog: configuring the metastore, designing the three-level namespace, creating managed and external objects, and setting up role-based access control with account-level groups and privilege inheritance. This chapter builds on that foundation by addressing the security, compliance, and governance capabilities that turn a functional Databricks environment into an...