Transforming and preparing your data via Azure Databricks
In this recipe, you will learn how to call Azure Databricks notebooks from ADF pipelines.
Getting ready
Before we start, please ensure that you have an Azure license, have a basic knowledge of coding, and are familiar with the basics of Azure resources, such as the Azure portal, creating and deleting Azure resources, and creating pipelines in ADF. You can find more information about Azure resources in Chapter 1, Getting Started with ADF, and Chapter 2, Orchestration and Control Flow, of this book.
How to do it…
We are going to set up an Azure Databricks service, create a new cluster, create a Databricks notebook, and call it from our ADF pipeline: