Book Image

Azure Databricks Cookbook

By : Phani Raj, Vinod Jaiswal
Book Image

Azure Databricks Cookbook

By: Phani Raj, Vinod Jaiswal

Overview of this book

Azure Databricks is a unified collaborative platform for performing scalable analytics in an interactive environment. The Azure Databricks Cookbook provides recipes to get hands-on with the analytics process, including ingesting data from various batch and streaming sources and building a modern data warehouse. The book starts by teaching you how to create an Azure Databricks instance within the Azure portal, Azure CLI, and ARM templates. You’ll work through clusters in Databricks and explore recipes for ingesting data from sources, including files, databases, and streaming sources such as Apache Kafka and EventHub. The book will help you explore all the features supported by Azure Databricks for building powerful end-to-end data pipelines. You'll also find out how to build a modern data warehouse by using Delta tables and Azure Synapse Analytics. Later, you’ll learn how to write ad hoc queries and extract meaningful insights from the data lake by creating visualizations and dashboards with Databricks SQL. Finally, you'll deploy and productionize a data pipeline as well as deploy notebooks and Azure Databricks service using continuous integration and continuous delivery (CI/CD). By the end of this Azure book, you'll be able to use Azure Databricks to streamline different processes involved in building data-driven apps.
Table of Contents (12 chapters)

How to restrict data access to users using ACLs

In this recipe, you will learn how to use ACLs to restrict access to data for individual files and directories, without assigning Azure Storage Blob-related roles to the AAD user/group in an ADLS Gen-2 Storage Account.

In the next section, you will learn about the prerequisites for getting started with this recipe.

Getting ready

Before starting, you need to ensure you have completed the Creating ACLs using Storage Explorer and PowerShell recipe.

We haven't assigned any Azure Storage Blob-related roles to Appuser yet, as shown in the following screenshot:

Figure 10.25 – Role assignments to Appuser

You can find the Notebook that was used for this recipe at the following link:

https://github.com/PacktPublishing/Azure-Databricks-Cookbook/blob/main/Chapter10/Code/10.5-ACL.ipynb

In this recipe, we will create a container called rawdata in an ADLS Gen-2 Storage account and copy the Customer...