Book Image

Data Analytics Using Splunk 9.x

By : Dr. Nadine Shillingford
5 (1)
Book Image

Data Analytics Using Splunk 9.x

5 (1)
By: Dr. Nadine Shillingford

Overview of this book

Splunk 9 improves on the existing Splunk tool to include important features such as federated search, observability, performance improvements, and dashboarding. This book helps you to make the best use of the impressive and new features to prepare a Splunk installation that can be employed in the data analysis process. Starting with an introduction to the different Splunk components, such as indexers, search heads, and forwarders, this Splunk book takes you through the step-by-step installation and configuration instructions for basic Splunk components using Amazon Web Services (AWS) instances. You’ll import the BOTS v1 dataset into a search head and begin exploring data using the Splunk Search Processing Language (SPL), covering various types of Splunk commands, lookups, and macros. After that, you’ll create tables, charts, and dashboards using Splunk’s new Dashboard Studio, and then advance to work with clustering, container management, data models, federated search, bucket merging, and more. By the end of the book, you’ll not only have learned everything about the latest features of Splunk 9 but also have a solid understanding of the performance tuning techniques in the latest version.
Table of Contents (18 chapters)
1
Part 1: Getting Started with Splunk
5
Part 2: Visualizing Data with Splunk
10
Part 3: Advanced Topics in Splunk

Exploring Splunk queues

The Splunk data pipeline is a series of processes that converts incoming data into Splunk events. These processes include breaking data into events, defining the timestamp, and extracting fields. We will use a set of keywords throughout this section, including pipeline, processor, and queue. A pipeline is a Splunk thread. There can be multiple pipelines running at the same time. There may be multiple processors/processes within a pipeline. The queue is the data structure that stores data between pipelines. Data coming into Splunk is queued before it can be processed. If a process takes longer than usual, the queues fill up. In this section, we will discuss the different segments of the Splunk data pipeline. Figure 8.8 shows the relationship between queues, processors, and pipelines:

Figure 8.8 – Queues, pipelines, and processors

Figure 8.8 – Queues, pipelines, and processors

The Splunk data pipeline consists of four main segments:

  • Parsing
  • Merging
  • Typing...