Book Image

OpenStack Sahara Essentials

By : Omar Khedher
Book Image

OpenStack Sahara Essentials

By: Omar Khedher

Overview of this book

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack. The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara. The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.
Table of Contents (14 chapters)

Chapter 4. Executing Jobs with Sahara

In the preceding chapter, we looked at how a Hadoop cluster can be created in OpenStack by means of templates. In this chapter, we will use the cluster by running and executing Hadoop jobs efficiently. Keep in mind that running jobs in Sahara depends on the choice of Elastic Data Processing (EDP) provisioning plugin discussed in the previous chapter. Thus, this chapter will guide you through the following points:

  • Understanding the essential components to run an EDP job in Sahara

  • Discussing the data source workflow in Sahara

  • Configuring a job in Sahara

  • Gathering the pieces together by executing a job in Sahara using Horizon

  • Enhancing EDP in Sahara using REST APIs

  • Executing a Spark job using the Sahara REST API