Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Real-Time Big Data Analytics
  • Table Of Contents Toc
Real-Time Big Data Analytics

Real-Time Big Data Analytics

By : Shilpi Saxena
4.5 (2)
Buy this Book
close
close
Real-Time Big Data Analytics

Real-Time Big Data Analytics

4.5 (2)
By: Shilpi Saxena
Buy this Book

Overview of this book

Enterprise has been striving hard to deal with the challenges of data arriving in real time or near real time. Although there are technologies such as Storm and Spark (and many more) that solve the challenges of real-time data, using the appropriate technology/framework for the right business use case is the key to success. This book provides you with the skills required to quickly design, implement and deploy your real-time analytics using real-world examples of big data use cases. From the beginning of the book, we will cover the basics of varied real-time data processing frameworks and technologies. We will discuss and explain the differences between batch and real-time processing in detail, and will also explore the techniques and programming concepts using Apache Storm. Moving on, we’ll familiarize you with “Amazon Kinesis” for real-time data processing on cloud. We will further develop your understanding of real-time analytics through a comprehensive review of Apache Spark along with the high-level architecture and the building blocks of a Spark program. You will learn how to transform your data, get an output from transformations, and persist your results using Spark RDDs, using an interface called Spark SQL to work with Spark. At the end of this book, we will introduce Spark Streaming, the streaming library of Spark, and will walk you through the emerging Lambda Architecture (LA), which provides a hybrid platform for big data processing by combining real-time and precomputed batch data to provide a near real-time view of incoming data.
Table of Contents (12 chapters)
close
close
close
Preface
chevron up
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Introducing the Big Data Technology Landscape and Analytics Platform
Icon
1. Introducing the Big Data Technology Landscape and Analytics Platform
Icon
Big Data – a phenomenon
Icon
The Big Data dimensional paradigm
Icon
The Big Data ecosystem
Icon
The Big Data infrastructure
Icon
Components of the Big Data ecosystem
Icon
Distributed batch processing
Icon
Distributed databases (NoSQL)
Icon
Real-time processing
Icon
Summary
2
2. Getting Acquainted with Storm
Icon
2. Getting Acquainted with Storm
Icon
An overview of Storm
Icon
Storm architecture and its components
Icon
How and when to use Storm
Icon
Storm internals
Icon
Summary
3
3. Processing Data with Storm
Icon
3. Processing Data with Storm
Icon
Storm input sources
Icon
Other sources for input to Storm
Icon
Reliability of data processing
Icon
Storm simple patterns
Icon
Storm persistence
Icon
Summary
4
4. Introduction to Trident and Optimizing Storm Performance
Icon
4. Introduction to Trident and Optimizing Storm Performance
Icon
Working with Trident
Icon
Understanding LMAX
Icon
Storm internode communication
Icon
Understanding the Storm UI
Icon
Optimizing Storm performance
Icon
Summary
5
5. Getting Acquainted with Kinesis
Icon
5. Getting Acquainted with Kinesis
Icon
Architectural overview of Kinesis
Icon
Creating a Kinesis streaming service
Icon
Summary
6
6. Getting Acquainted with Spark
Icon
6. Getting Acquainted with Spark
Icon
An overview of Spark
Icon
The architecture of Spark
Icon
Resilient distributed datasets (RDD)
Icon
Writing and executing our first Spark program
Icon
Summary
7
7. Programming with RDDs
Icon
7. Programming with RDDs
Icon
Understanding Spark transformations and actions
Icon
Programming Spark transformations and actions
Icon
Handling persistence in Spark
Icon
Summary
8
8. SQL Query Engine for Spark – Spark SQL
Icon
8. SQL Query Engine for Spark – Spark SQL
Icon
The architecture of Spark SQL
Icon
Coding our first Spark SQL job
Icon
Converting RDDs to DataFrames
Icon
Working with Parquet
Icon
Working with Hive tables
Icon
Performance tuning and best practices
Icon
Summary
9
9. Analysis of Streaming Data Using Spark Streaming
Icon
9. Analysis of Streaming Data Using Spark Streaming
Icon
High-level architecture
Icon
Coding our first Spark Streaming job
Icon
Querying streaming data in real time
Icon
Deployment and monitoring
Icon
Summary
10
10. Introducing Lambda Architecture
Icon
10. Introducing Lambda Architecture
Icon
What is Lambda Architecture
Icon
The technology matrix for Lambda Architecture
Icon
Realization of Lambda Architecture
Icon
Summary
11
Index
Icon
Index

Customer support

Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.

Downloading the example code

You can download the example code files for this book from your account at http://www.packtpub.com. If you purchased this book elsewhere, you can visit http://www.packtpub.com/support and register to have the files e-mailed directly to you.

You can download the code files by following these steps:

  1. Log in or register to our website using your e-mail address and password.
  2. Hover the mouse pointer on the SUPPORT tab at the top.
  3. Click on Code Downloads & Errata.
  4. Enter the name of the book in the Search box.
  5. Select the book for which you're looking to download the code files.
  6. Choose from the drop-down menu where you purchased this book from.
  7. Click on Code Download.

Once the file is downloaded, please make sure that you unzip or extract the folder using the latest version of:

  • WinRAR / 7-Zip for Windows
  • Zipeg / iZip / UnRarX for Mac
  • 7-Zip / PeaZip for Linux

Errata

Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing so, you can save other readers from frustration and help us improve subsequent versions of this book. If you find any errata, please report them by visiting http://www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details of your errata. Once your errata are verified, your submission will be accepted and the errata will be uploaded to our website or added to any list of existing errata under the Errata section of that title.

To view the previously submitted errata, go to https://www.packtpub.com/books/content/support and enter the name of the book in the search field. The required information will appear under the Errata section.

Piracy

Piracy of copyrighted material on the Internet is an ongoing problem across all media. At Packt, we take the protection of our copyright and licenses very seriously. If you come across any illegal copies of our works in any form on the Internet, please provide us with the location address or website name immediately so that we can pursue a remedy.

Please contact us at with a link to the suspected pirated material.

We appreciate your help in protecting our authors and our ability to bring you valuable content.

Questions

If you have a problem with any aspect of this book, you can contact us at , and we will do our best to address the problem.

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Real-Time Big Data Analytics
Next Chapter
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon