Book Image

Stream Analytics with Microsoft Azure

By : Ryan Murphy, Manpreet Singh
Book Image

Stream Analytics with Microsoft Azure

By: Ryan Murphy, Manpreet Singh

Overview of this book

Microsoft Azure is a very popular cloud computing service used by many organizations around the world. Its latest analytics offering, Stream Analytics, allows you to process and get actionable insights from different kinds of data in real-time. This book is your guide to understanding the basics of how Azure Stream Analytics works, and building your own analytics solution using its capabilities. You will start with understanding what Stream Analytics is, and why it is a popular choice for getting real-time insights from data. Then, you will be introduced to Azure Stream Analytics, and see how you can use the tools and functions in Azure to develop your own Streaming Analytics. Over the course of the book, you will be given comparative analytic guidance on using Azure Streaming with other Microsoft Data Platform resources such as Big Data Lambda Architecture integration for real time data analysis and differences of scenarios for architecture designing with Azure HDInsight Hadoop clusters with Storm or Stream Analytics. The book also shows you how you can manage, monitor, and scale your solution for optimal performance. By the end of this book, you will be well-versed in using Azure Stream Analytics to develop an efficient analytics solution that can work with any type of data.
Table of Contents (18 chapters)
Title Page
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Customer Feedback
Preface

What is Big Data Lambda Architecture?


There are scenarios of fast and slow data processing in terms of hot and cold paths of event streaming respectively in this era of big data and Internet of Things (IoT). In data-oriented software systems, the architecture pattern that has been derived to handle both fast and persistent data paths simultaneously is known as Lambda Architecture. It's a powerful data processing pattern utilized for both big data and IoT data processing architectures.

Lambda Architecture gives the benefit of handling massive amounts of petabyte-scale data to be processed both in batch as well as interactive mode.

Concepts of batch processing and stream processing in data analytics

The execution of a job in a series of small processes (batch) is known as batch processing, where the input data is divided into a number of chunks with a series of batch jobs. According to Wikipedia, the batch data processing has prevailed from the early nineteenth century for the processing of punch...