Book Image

Data Analytics Using Splunk 9.x

By : Dr. Nadine Shillingford
5 (1)
Book Image

Data Analytics Using Splunk 9.x

5 (1)
By: Dr. Nadine Shillingford

Overview of this book

Splunk 9 improves on the existing Splunk tool to include important features such as federated search, observability, performance improvements, and dashboarding. This book helps you to make the best use of the impressive and new features to prepare a Splunk installation that can be employed in the data analysis process. Starting with an introduction to the different Splunk components, such as indexers, search heads, and forwarders, this Splunk book takes you through the step-by-step installation and configuration instructions for basic Splunk components using Amazon Web Services (AWS) instances. You’ll import the BOTS v1 dataset into a search head and begin exploring data using the Splunk Search Processing Language (SPL), covering various types of Splunk commands, lookups, and macros. After that, you’ll create tables, charts, and dashboards using Splunk’s new Dashboard Studio, and then advance to work with clustering, container management, data models, federated search, bucket merging, and more. By the end of the book, you’ll not only have learned everything about the latest features of Splunk 9 but also have a solid understanding of the performance tuning techniques in the latest version.
Table of Contents (18 chapters)
1
Part 1: Getting Started with Splunk
5
Part 2: Visualizing Data with Splunk
10
Part 3: Advanced Topics in Splunk

Extracting fields using props.conf and transforms.conf

So far, we have created field aliases, calculated fields, and field extractions using Splunk Web. These changes can also be made using configuration files. Let’s look at the changes in the configuration files that occurred when we created the http_referer and referer_domain fields in the previous section, Extracting fields using the GUI. Use a ssh client to connect to searchhead1 and browse to /opt/splunk/etc/apps/botsv1_data_set/local/props.conf. You should see the following configurations under the [iis] and [suricata] stanzas:

[iis]
FIELDALIAS-http_refer_rename = cs_Referer ASNEW http_referer
EXTRACT-referer_domain = http://(?<referer_domain>(\w+\.\w+|\d+\.\d+\.\d+\.\d+))\/
[suricata]
EVAL-bytes = bytes_in + bytes_out

Since the field alias (http_referer) and the field extraction (referer_domain) are associated with the IIS sourcetype, they are inserted under the [iis] stanza. The calculated field (bytes) was...