Book Image

Mastering Kibana 6.x

Book Image

Mastering Kibana 6.x

Overview of this book

Kibana is one of the popular tools among data enthusiasts for slicing and dicing large datasets and uncovering Business Intelligence (BI) with the help of its rich and powerful visualizations. To begin with, Mastering Kibana 6.x quickly introduces you to the features of Kibana 6.x, before teaching you how to create smart dashboards in no time. You will explore metric analytics and graph exploration, followed by understanding how to quickly customize Kibana dashboards. In addition to this, you will learn advanced analytics such as maps, hits, and list analytics. All this will help you enhance your skills in running and comparing multiple queries and filters, influencing your data visualization skills at scale. With Kibana’s Timelion feature, you can analyze time series data with histograms and stats analytics. By the end of this book, you will have created a speedy machine learning job using X-Pack capabilities.
Table of Contents (21 chapters)
Title Page
Copyright and Credits
Packt Upsell
Contributors
Preface
Index

Preface

Kibana is a powerful visualization tool which can be use to solve different types of problems. The basic use of Kibana is log management and it is mostly used for the log management only because it is quite difficult to handle the logs without a proper tool which can help us to explore, filter, search and visualize the logs. We can also use Kibana in many other areas like for security monitoring and alerting in which we use the tool to figure out any suspicious activity or attack. Machine learning is another important feature which was introduced in Kibana 5.4 and provides us the luxury to apply the machine learning algorithm directly on the index pattern data without any other software dependency.

The objective of this book is to first introduce the reader with basics of Kibana like installation, functioning and log management etc and then to explain some complex topics like Timelion, Machine Learning etc and at last to provide some practical explanation to setup the dashboard like creating dashboard using Beats and then through RDBMS data. So we can say that this book is a complete package and covers almost every aspect of Kibana.

Who this book is for

This book is for system admins, data analysts, programmers, and anyone who need a powerful dashboard using any sort of data. If you want to get complete insight of Kibana and how we can use it to solve our data exploration problems, you can refer to this book. This book is not a Kibana manual but a solution oriented approach where readers can get the idea to solve their problem in hand after learning the basics of Kibana. No prior Kibana knowledge is required for this book.

What this book covers

Chapter 1, Revising the ELK Stack, this chapter will explain details of ELK stack which is now known as Elastic Stack. Although they've all been built to work exceptionally well together, each one is a separate project that is driven by the open-source vendor Elastic. Through this chapter reader will get complete idea of these three software and will able to figure out that how we can combine these to achieve different use cases.

Chapter 2,Setting Up and Customizing the Kibana Dashboard, In this chapter we will know how to customize Kibana visualization by  adding title, resizing panels, change colors and opacity, modify the legends etc. This will also explain how we can embed the dashboard on our existing application, By tweaking these features we can create more meaningful and impact full dashboards. 

Chapter 3,  Exploring Your Data, Here we will come to know the Discover tab functionalities like Search Bar, Time Filter, Field Selector, Data Histogram and Log View. Discover option provide us the way to search and select required fields from our dataset. It provides us the complete picture of Elastic search data which is loaded into Kibana.

Chapter 4, Visualizing the Data, The Kibana Visualize page is where we can create, modify, and view our own custom visualizations. There are different types of visualizations, ranging from Vertical bar and Pie charts to Tile maps and Data tables. Different type of visualization can be created using Kibana Visualize option. Visualizations can also be shared with other users who have access to the Kibana instance.In this chapter reader will learn to create various types of data visualizations like Vertical bar,Pie charts, Tile maps,Data tables and tag clouds etc.

Chapter 5, Dashboarding to Showcase Key Performance Indicators, With a dashboard, we can combine multiple visualizations onto a single page. Here we can filter them by providing a search query or by selecting filters by clicking elements in the visualization. Dashboards are useful  when we want to get an overview of logs, and make correlations among various visualizations and logs. We can also export the csv data from data tables of Kibana.

Chapter 6, Handling Time Series Data with Timelion, In this chapter we will learn about Timelion which is a time series visualization plugin for Kibana which enables us to combine independent data sources within the same visualization. As with normal visualizations in Kibana, we can visualize Timelion expressions from the Visualize tab. It provides us various features such as function chaining, analyzing trends, data formatting, and performing basic calculations.

Chapter 7, Interact with Your Data Using Dev Tools , in this chapter we will learn aboutDev Tools which contains development tools that we can use to interact with data in Kibana. Console plugin of Kibana Dev Tools provides a UI to interact with the REST API of Elasticsearch. Console has two main areas: the editor, where we can compose requests to Elasticsearch, and the response pane, which displays the responses to the request.

Chapter 8, Tweaking Your Configuration with Kibana Management, in this chapter we will cover Kibana Management interface is used to perform  runtime configuration of Kibana, initial setup and ongoing configuration of index patterns, advanced settings that tweak the behaviors of Kibana itself, and  various "objects" that we can save throughout Kibana such as searches, visualizations, and dashboards.

Chapter 9, Understanding X-Pack Features , in this chapter we will come to know how to setup X-Pack and use different features like security, alerting, monitoring, reporting and machine learning. In default setup of ELK we do not have these features and for using X-Pack we need to purchase the license. X-Pack provide us the feature to secure the ELK stack will user role and permission.

Chapter 10, Machine Learning with Kibana, in this chapter we will learn about Machine learning which is the science of getting computers to act without being explicitly programmed. For applying machine learning on our dataset we need to use any programming language like R or Python but Kibana provides us a tab with X-Pack for creating machine learning jobs and managing them. We can apply machine learning in any time based dataset and can get the output in Kibana UI. We can detect anomalies, find root cause of any problem, easily forecast the future trends and find many answers from our data using machine learning.

Chapter 11, Create Super Cool Dashboard from a Web Application , in this chapter we will cover how we can create a super cool dashboard from an existing web application through  practical example. Here I will drive through application data flow from database to Kibana and then from Kibana visualization to Dashboard. The dashboard can independently be used or we can embed it in our web application.

Chapter 12, Different Use Cases of Kibana, in this chapter we will cover different important use cases of Kibana like handling time series data where we will cover conditional formatting and tracking trends etc. After that we will cover how to work with visual builder to handle the time series data and then will cover GeoIP for Elastic Search and how we can plot data on maps.

Chapter 13, Create Monitoring Dashboard Using Beats, in this chapter we will learn about Beats which works as a data shippers. This chapter will explain to create a quick monitoring dashboard using Beats. We will come to know about different type of beats like Metricbeat, Packetbeat, Filebeat, and so on. Here I will cover each steps from Beats configuration to dashboard creation.In this chapter reader would be able to create quick monitoring dashboard using Beats.

 Chapter 14, Best Practices, in this chapter we will cover different best practices which we need to ensure while working with Elastic Stack. By following these best practices we can get optimum performance from our Elastic stack setup.

To get the most out of this book

  1. Although it is not required but it would be beneficial if you have basic knowledge of charts.
  2. You should have a system access where you can install Elastic Stack and can follow the instructions given in the book.

Download the color images

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. You can download it here: http://www.packtpub.com/sites/default/files/downloads/MasteringKibana6x_ColorImages.pdf.

Conventions used

There are a number of text conventions used throughout this book.

CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, path names, dummy URLs, user input, and Twitter handles. Here is an example: "To run Logstash, we need to install Logstash and edit the configuration file logstash.conf."

A block of code is set as follows:

input {
     file {
         path => "/var/log/apache2/access.log"
         }
 }

Any command-line input or output is written as follows:

curl -L -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.1.3.tar.gz

Bold: Indicates a new term, an important word, or words that you see onscreen. For example, words in menus or dialog boxes appear in the text like this. Here is an example: "To get the statistics, we need to select Statistics from the dropdown."

 

Note

Warnings or important notes appear like this.

Note

Tips and tricks appear like this.

Get in touch

Feedback from our readers is always welcome.

General feedback: Email [email protected] and mention the book title in the subject of your message. If you have questions about any aspect of this book, please email us at [email protected].

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you would report this to us. Please visit www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details.

Piracy: If you come across any illegal copies of our works in any form on the Internet, we would be grateful if you would provide us with the location address or website name. Please contact us at [email protected] with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit authors.packtpub.com.

Reviews

Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions, we at Packt can understand what you think about our products, and our authors can see your feedback on their book. Thank you!

For more information about Packt, please visit packtpub.com.