Throughout the book, we mainly focused on how to write MapReduce jobs that dump data from HDFS to Elasticsearch and the other way round. We used Elasticsearch queries to get insights out of indexed data. The Hadoop ecosystem does a great job making Hadoop easily usable for different users by providing a comfortable interfacing. Examples of these are Hive and Pig. Apart from these, Hadoop integrates well with other computing engines and platforms, such as Spark and Cascading.
In this chapter, we will take a look at how ES-Hadoop can integrate with these Hadoop ecosystem technologies with equal ease to provide you with all the power that you currently have using Hadoop. The following topics will be covered in the chapter:
Pigging out Elasticsearch
SQLize Elasticsearch with Hive
Cascading with Elasticsearch
Giving Spark to Elasticsearch
Elasticsearch on YARN