Book Image

Learning Kibana 5.0

By : Bahaaldine Azarmi
Book Image

Learning Kibana 5.0

By: Bahaaldine Azarmi

Overview of this book

Kibana is an open source data visualization platform that allows you to interact with your data through stunning, powerful graphics. Its simple, browser-based interface enables you to quickly create and share dynamic dashboards that display changes to Elasticsearch queries in real time. In this book, you’ll learn how to use the Elastic stack on top of a data architecture to visualize data in real time. All data architectures have different requirements and expectations when it comes to visualizing the data, whether it’s logging analytics, metrics, business analytics, graph analytics, or scaling them as per your business requirements. This book will help you master Elastic visualization tools and adapt them to the requirements of your project. You will start by learning how to use the basic visualization features of Kibana 5. Then you will be shown how to implement a pure metric analytics architecture and visualize it using Timelion, a very recent and trendy feature of the Elastic stack. You will learn how to correlate data using the brand-new Graph visualization and build relationships between documents. Finally, you will be familiarized with the setup of a Kibana development environment so that you can build a custom Kibana plugin. By the end of this book you will have all the information needed to take your Elastic stack skills to a new level of data visualization.
Table of Contents (17 chapters)
Learning Kibana 5.0
Credits
About the Author
About the Reviewers
www.PacktPub.com
Customer Feedback
Dedication
Preface

Preface

Today, understanding data, whatever the nature of the data is, keeps getting harder. They are couple of reasons for that such as the volume, the variety of data, the pace at which the data is created and the complexity to correlate data from different sources.

It’s hard for anyone to cope with this constant increasing challenge, that’s why more and more applications are built to facilitate data management, at every level: ingesting data, processing data, storing data, and ultimately visualizing the data to understand it.

All those levels put together are the fundamental layers to build a data-driven architecture that needs to scale with a growing demand and expectation from users.

There is tons of software and applications out there that could answer those challenges, but rarely will you find a stack that could fulfill all the requirements altogether and across many types of use cases.

The Elastic Stack is one of them: it gives the user a way to access their data in an agile and scalable way. Kibana is part of the Elastic Stack and provide a visualization layer on top of data indexed in Elasticsearch, the storage layer.

In Learning Kibana 5.0, we’ll go through the holistic visualization experience that Kibana offers to address very different use cases, such as creating dashboards using accidents data, or building statistics on top system data, or even detecting anomalies in data.

Rather than listing and going through Kibana features one by one, this book adopts a pragmatic approach where you will learn based on concrete examples and hands-on.

What this book covers 

Chapter 1, Introduction to Data-Driven Architecture, describes the fundamental layers that compose a data-driven architecture, and how the Elastic Stack can be used to build it. 

Chapter 2, Installing and Setting up Kibana 5.0, covers the installation of Elasticsearch and Kibana, and a walkthrough in Kibana 5.0 anatomy.

Chapter 3, Business Analytics with Kibana 5.0, tackles the first use case of this book, namely business analytics, with the help of Paris accidentology data.

Chapter 4, Logging Analytics with Kibana 5.0, covers a technical logging use case on top of Apache logs data.

Chapter 5, Metric Analytics with Metricbeat and Kibana 5.0, walks the reader through the brand new feature of metrics analytics in Kibana 5.0 with the help of system data from Metricbeat.

Chapter 6, Graph Exploration in Kibana, explains the concept of graphs in the Elastic Stack and introduces forensic graph analysis on top of Stack Overflow data.

Chapter 7, Customizing Kibana 5.0 Timelion, shows how to extend the capabilities of Timelion and build an extension to fetch data from Google Analytics.

Chapter 8, Anomaly Detection in Kibana 5.0, covers the Elastic Stack machine learning features and how to use Kibana to visualize anomalies on top of system data.

Chapter 9, Creating a Custom Plugin for Kibana 5.0, explains how to create a plugin to visualize the Elasticsearch cluster topology.

What you need for this book 

In this book, you will need to download and install the Elastic Stack, specifically, Elasticsearch, Kibana, Metricbeat, Logstash, and the X-Pack. All the software is available from the following page: http://www.elastic.co/downloads.

The Elastic Stack can be run on a various environment on commodity machines; here is the support matrix: https://www.elastic.co/support/matrix.

Who this book is for 

This book is for developers, operation teams, business analytics, and data architects who want to learn how to deploy a data-driven architecture using the Elastic Stack 5.0, and more specifically, how to enable visualization on top of the data indexed in Elasticsearch with Kibana 5.0.

Conventions 

In this book, you will find a number of text styles that distinguish between different kinds of information. Here are some examples of these styles and an explanation of their meaning.

Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles are shown as follows: "We can include other contexts through the use of the include directive."

A block of code is set as follows:

PUT /_snapshot/basic_logstash_repository
{
  "type": "fs",
  "settings": {
  "location":  
    "/Users/bahaaldine/Dropbox/Packt/sources/chapter3/
      basic_logstash_repository",
  "compress": true
  }
}

Any command-line input or output is written as follows:

GET _cat/indices/basic*

New terms and important words are shown in bold. Words that you see on the screen, for example, in menus or dialog boxes, appear in the text like this: "Clicking the Next button moves you to the next screen."

Note

Warnings or important notes appear in a box like this.

Tip

Tips and tricks appear like this.

Reader feedback

Feedback from our readers is always welcome. Let us know what you think about this book—what you liked or disliked. Reader feedback is important for us as it helps us develop titles that you will really get the most out of.

To send us general feedback, simply e-mail [email protected], and mention the book's title in the subject of your message.

If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, see our author guide at www.packtpub.com/authors.

Customer support

Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.

Downloading the example code 

You can download the example code files for this book from your account at http://www.packtpub.com. If you purchased this book elsewhere, you can visit http://www.packtpub.com/support and register to have the files e-mailed directly to you.

You can download the code files by following these steps:

  1. Log in or register to our website using your e-mail address and password.

  2. Hover the mouse pointer on the SUPPORT tab at the top.

  3. Click on Code Downloads & Errata.

  4. Enter the name of the book in the Search box.

  5. Select the book for which you're looking to download the code files.

  6. Choose from the drop-down menu where you purchased this book from.

  7. Click on Code Download.

You can also download the code files by clicking on the Code Files button on the book's webpage at the Packt Publishing website. This page can be accessed by entering the book's name in the Search box. Please note that you need to be logged in to your Packt account.

Once the file is downloaded, please make sure that you unzip or extract the folder using the latest version of:

  • WinRAR / 7-Zip for Windows

  • Zipeg / iZip / UnRarX for Mac

  • 7-Zip / PeaZip for Linux

The code bundle for the book is also hosted on GitHub at https://github.com/PacktPublishing/Learning-Kibana-5. We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/. Check them out!

Downloading the color images of this book

We also provide you with a PDF file that has color images of the screenshots/diagrams used in this book. The color images will help you better understand the changes in the output. You can download this file from https://www.packtpub.com/sites/default/files/downloads/LearningKibana5_ColorImages.pdf.

Errata

Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing so, you can save other readers from frustration and help us improve subsequent versions of this book. If you find any errata, please report them by visiting http://www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details of your errata. Once your errata are verified, your submission will be accepted and the errata will be uploaded to our website or added to any list of existing errata under the Errata section of that title.

To view the previously submitted errata, go to https://www.packtpub.com/books/content/support and enter the name of the book in the search field. The required information will appear under the Errata section.

Piracy

Piracy of copyrighted material on the Internet is an ongoing problem across all media. At Packt, we take the protection of our copyright and licenses very seriously. If you come across any illegal copies of our works in any form on the Internet, please provide us with the location address or website name immediately so that we can pursue a remedy.

Please contact us at [email protected] with a link to the suspected pirated material.

We appreciate your help in protecting our authors and our ability to bring you valuable content.

Questions

If you have a problem with any aspect of this book, you can contact us at [email protected], and we will do our best to address the problem.