Book Image

Learning Elastic Stack 7.0 - Second Edition

By : Pranav Shukla, Sharath Kumar M N
Book Image

Learning Elastic Stack 7.0 - Second Edition

By: Pranav Shukla, Sharath Kumar M N

Overview of this book

The Elastic Stack is a powerful combination of tools that help in performing distributed search, analytics, logging, and visualization of data. Elastic Stack 7.0 encompasses new features and capabilities that will enable you to find unique insights into analytics using these techniques. This book will give you a fundamental understanding of what the stack is all about, and guide you in using it efficiently to build powerful real-time data processing applications. The first few sections of the book will help you understand how to set up the stack by installing tools and exploring their basic configurations. You’ll then get up to speed with using Elasticsearch for distributed search and analytics, Logstash for logging, and Kibana for data visualization. As you work through the book, you will discover the technique of creating custom plugins using Kibana and Beats. This is followed by coverage of the Elastic X-Pack, a useful extension for effective security and monitoring. You’ll also find helpful tips on how to use Elastic Cloud and deploy Elastic Stack in production environments. By the end of this book, you’ll be well-versed with fundamental Elastic Stack functionalities and the role of each component in the stack to solve different data processing problems.
Table of Contents (17 chapters)
Free Chapter
1
Section 1: Introduction to Elastic Stack and Elasticsearch
4
Section 2: Analytics and Visualizing Data
10
Section 3: Elastic Stack Extensions
12
Section 4: Production and Server Infrastructure

Visualizing the data in Kibana

We have successfully set up the Logstash data pipeline and loaded some data using the pipeline into Elasticsearch. It is time to explore the data and build a dashboard that will help us gain some insights into the data.

Let's start by doing a sanity check to see if the data is loaded correctly. We can do so by going to Kibana Dev Tools and executing the following query:

GET /sensor_data-*/_search?size=0&track_total_hits=true
{
"query": {"match_all": {}}
}

This query will search data across all indices matching the sensor_data-* pattern. There should be a good number of records in the index if the data was indexed correctly.

We will cover the following topics:

  • Set up an index pattern in Kibana
  • Build visualizations
  • Create a dashboard using the visualizations

Let's go through each step.

...