Book Image

Implementing Splunk 7, Third Edition - Third Edition

Book Image

Implementing Splunk 7, Third Edition - Third Edition

Overview of this book

Splunk is the leading platform that fosters an efficient methodology and delivers ways to search, monitor, and analyze growing amounts of big data. This book will allow you to implement new services and utilize them to quickly and efficiently process machine-generated big data. We introduce you to all the new features, improvements, and offerings of Splunk 7. We cover the new modules of Splunk: Splunk Cloud and the Machine Learning Toolkit to ease data usage. Furthermore, you will learn to use search terms effectively with Boolean and grouping operators. You will learn not only how to modify your search to make your searches fast but also how to use wildcards efficiently. Later you will learn how to use stats to aggregate values, a chart to turn data, and a time chart to show values over time; you'll also work with fields and chart enhancements and learn how to create a data model with faster data model acceleration. Once this is done, you will learn about XML Dashboards, working with apps, building advanced dashboards, configuring and extending Splunk, advanced deployments, and more. Finally, we teach you how to use the Machine Learning Toolkit and best practices and tips to help you implement Splunk services effectively and efficiently. By the end of this book, you will have learned about the Splunk software as a whole and implemented Splunk services in your tasks at projects
Table of Contents (19 chapters)
Title Page
Packt Upsell
Contributors
Preface
Index

Chapter 10. Summary Indexes and CSV Files

As the number of events retrieved by a query increases, the performance decreases linearly. Summary indexing allows you to calculate the statistics in advance and then run reports against these roll ups, dramatically increasing performance.

In this chapter, we will cover the following topics:

  • Understanding summary indexes
  • When to use a summary index
  • When not to use a summary index
  • Populating summary indexes with saved searches
  • Using summary index events in a query
  • Using sistats, sitop, and sitimechart
  • How latency affects summary queries
  • How and when to backfill summary data
  • Reducing summary index size
  • Calculating top for a large time frame
  • Using CSV files to store transient data
  • Speeding up queries and backfilling