Book Image

Azure Synapse Analytics Cookbook

By : Gaurav Agarwal, Meenakshi Muralidharan
Book Image

Azure Synapse Analytics Cookbook

By: Gaurav Agarwal, Meenakshi Muralidharan

Overview of this book

As data warehouse management becomes increasingly integral to successful organizations, choosing and running the right solution is more important than ever. Microsoft Azure Synapse is an enterprise-grade, cloud-based data warehousing platform, and this book holds the key to using Synapse to its full potential. If you want the skills and confidence to create a robust enterprise analytical platform, this cookbook is a great place to start. You'll learn and execute enterprise-level deployments on medium-to-large data platforms. Using the step-by-step recipes and accompanying theory covered in this book, you'll understand how to integrate various services with Synapse to make it a robust solution for all your data needs. Whether you're new to Azure Synapse or just getting started, you'll find the instructions you need to solve any problem you may face, including using Azure services for data visualization as well as for artificial intelligence (AI) and machine learning (ML) solutions. By the end of this Azure book, you'll have the skills you need to implement an enterprise-grade analytical platform, enabling your organization to explore and manage heterogeneous data workloads and employ various data integration services to solve real-time industry problems.
Table of Contents (11 chapters)

Integrating an Azure Synapse ETL pipeline with Cosmos DB

In this section, we will understand Azure Synapse Link for Cosmos DB and its usage for real-time analytics. We will learn about the following topics:

  • The basics of Cosmos DB
  • Azure Synapse Link integration with Cosmos DB
  • Feature support of Cosmos DB with Synapse
  • Synapse runtime support
  • Structured streaming support
  • Security features of Cosmos DB

Introducing Cosmos DB

Azure Cosmos DB is a fully isolated columnar store for large-scale analytics with operational data and a transactional store that is schema-agnostic, which allows us to use it with transactional applications without the overhead of managing schema or indexes.

Azure Cosmos DB analytical store is optimized for use for analytical workloads, which offers good analytical query performance.

When operational data is stored in a transaction store in row store format, analytical queries would be expensive, since we need provisioned...