Book Image

Cloud Scale Analytics with Azure Data Services

By : Patrik Borosch
Book Image

Cloud Scale Analytics with Azure Data Services

By: Patrik Borosch

Overview of this book

Azure Data Lake, the modern data warehouse architecture, and related data services on Azure enable organizations to build their own customized analytical platform to fit any analytical requirements in terms of volume, speed, and quality. This book is your guide to learning all the features and capabilities of Azure data services for storing, processing, and analyzing data (structured, unstructured, and semi-structured) of any size. You will explore key techniques for ingesting and storing data and perform batch, streaming, and interactive analytics. The book also shows you how to overcome various challenges and complexities relating to productivity and scaling. Next, you will be able to develop and run massive data workloads to perform different actions. Using a cloud-based big data-modern data warehouse-analytics setup, you will also be able to build secure, scalable data estates for enterprises. Finally, you will not only learn how to develop a data warehouse but also understand how to create enterprise-grade security and auditing big data programs. By the end of this Azure book, you will have learned how to develop a powerful and efficient analytical platform to meet enterprise needs.
Table of Contents (20 chapters)
1
Section 1: Data Warehousing and Considerations Regarding Cloud Computing
4
Section 2: The Storage Layer
7
Section 3: Cloud-Scale Data Integration and Data Transformation
14
Section 4: Data Presentation, Dashboarding, and Distribution

Talking about backups

In every well-designed system, you want to have your data lake secured against data losses. As we saw at the beginning of this chapter, while creating our Data Lake Storage Gen2 account, there are different levels of redundancy that you can configure for your storage. But replication is only one facet of preventing data loss.

Configuring delete locks for the storage service

To avoid your storage service from being deleted by accident (yes, this can happen!), you must place a delete lock on your storage account. This will cause Azure to block any delete action and prompt the user to first get rid of the delete lock. Follow these steps to set this up:

  1. Navigate to the Locks entry in the Settings section of the Navigation blade of your Data Lake storage account.
  2. Here, you can add a lock of the Delete type to your account.

You can also set the whole account to Read-only if you need to.

Backing up your data

At the time of writing, there...