Book Overview & Buying
Table Of Contents
Feedback & Rating

Hands-On Data Warehousing with Azure Data Factory

By : Cote, Michelle Gutzait, Giuseppe Ciaburro

2.8 (10)

Buy this Book

Hands-On Data Warehousing with Azure Data Factory

2.8 (10)

By: Cote, Michelle Gutzait, Giuseppe Ciaburro

Buy this Book

Overview of this book

ETL is one of the essential techniques in data processing. Given data is everywhere, ETL will always be the vital process to handle data from different sources. Hands-On Data Warehousing with Azure Data Factory starts with the basic concepts of data warehousing and ETL process. You will learn how Azure Data Factory and SSIS can be used to understand the key components of an ETL solution. You will go through different services offered by Azure that can be used by ADF and SSIS, such as Azure Data Lake Analytics, Machine Learning and Databrick’s Spark with the help of practical examples. You will explore how to design and implement ETL hybrid solutions using different integration services with a step-by-step approach. Once you get to grips with all this, you will use Power BI to interact with data coming from different sources in order to reveal valuable insights. By the end of this book, you will not only learn how to build your own ETL solutions but also address the key challenges that are faced while building them.

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

The Modern Data Warehouse

The need for a data warehouse

The modern data warehouse

What's new in V2.0?

Summary

Getting Started with Our First Data Factory

Resource group

Azure Data Factory

Azure Blob storage

Types of blobs

SQL Azure database

Summary

SSIS Lift and Shift

SSIS in ADF

Leveraging our package in ADF V2

Summary

Azure Data Lake

Creating and configuring Data Lake Store

Creating a Data Lake Analytics resource

Using the data factory to manipulate data in the Data Lake

Run U-SQL from a job in the Data Lake Analytics

Summary

Machine Learning on the Cloud

Machine learning overview

Machine learning tasks

Azure Machine Learning Studio

Breast cancer detection

Summary

Introduction to Azure Databricks

Azure Databricks setup

Prepare the data to ingest

Copy data from SQL Server to sales-data

Databricks notebook

Calling Databricks notebook execution in ADF

Summary

Reporting on the Modern Data Warehouse

Different types of BI

Power BI consumption

Creating our Power BI reports

Incorporating Spark data

Summary

Customer Reviews

2.8 (10)

5 star

10%

4 star

30%

3 star

10%

2 star

30%

1 star

20%

The Modern Data Warehouse

Azure Data Factory (ADF) is a service that is available in the Microsoft Azure ecosystem. This service allows the orchestration of different data loads and transfers in Azure.

Back in 2014, there were hardly any easy ways to schedule data transfers in Azure. There were a few open source solutions available, such as Apache Falcon and Oozie, but nothing was easily available as a service in Azure. Microsoft introduced ADF in public preview in October 2014, and the service went to general availability in July 2015.

The service allows the following actions:

Copying data from various sources and destinations
Calling various computation services, such as HDInsight and Azure data warehouse data transformations
Orchestrating the preceding activities using time slices and retrying the activities when there is an error

All these activities were available via the Azure portal at first, and in Visual Studio 2013 before general availability (GA).