Book Image

OpenStack Sahara Essentials

By : Omar Khedher
Book Image

OpenStack Sahara Essentials

By: Omar Khedher

Overview of this book

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack. The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara. The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.
Table of Contents (14 chapters)

Sahara plugins


Sahara exposes several provisioning plugins in order to deploy a specific data processing distribution. This becomes highly important for vendor plugins wishing to write code that comply with their API and distribution. The OpenStack Liberty release supports the following provisioning plugins as shown in Horizon:

Provisioning plugins sit in the middle of the architecture of Sahara as shown as follows:

Each OpenStack release provides a new version of a plugin. Thus, in order to support an existing Hadoop framework or to leverage a specific version of the Hadoop API, it might be essential to select the right version and check the supported features and updates for each plugin. To make it much easier, the next section will highlight different supported plugins and versions in the Liberty release by examining the capabilities of each of them.

Vanilla Apache Hadoop

The Vanilla Apache Hadoop plugin in the Liberty release supports the Hadoop 2.6.0 and 2.7.1 versions. OpenStack also supports...