We have successfully set up the Logstash data pipeline and loaded some data using the pipeline into Elasticsearch. It is time to explore the data and build a dashboard that will help us gain some insights into the data.
Let's start by doing a sanity check to see if the data is loaded correctly. We can do so by going to Kibana Dev Tools and executing the following query:
GET /sensor_data-*/_search?size=0&track_total_hits=true
{
"query": {"match_all": {}}
}
This query will search data across all indices matching the sensor_data-* pattern. There should be a good number of records in the index if the data was indexed correctly.
We will cover the following topics:
- Set up an index pattern in Kibana
- Build visualizations
- Create a dashboard using the visualizations
Let's go through each step.