Book Image

OpenStack Sahara Essentials

By : Omar Khedher
Book Image

OpenStack Sahara Essentials

By: Omar Khedher

Overview of this book

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack. The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara. The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.
Table of Contents (14 chapters)

CDH high-availability support


The CDH 5.4.0 plugin allows the building of a high-availability CDH cluster through HDFS cluster groups. This can be achieved by setting up a YARN HA ResourceManager in Active/Standby mode architecture. The Sahara plugins deploys automatically the CDH cluster, and if HA enabled, ResourceManagers can fail over automatically through its failover controller or manually using the admin command-line interface. As shown in the next diagram, any active ResourceManager in the cluster needs to write its current states into ZooKeeper clusters. When the failure occurs, the StandBy ResourceManager will be promoted to be active and starts to load the ResourceManager state:

Like HDP, there are few requirements in order to support HA functionality in Sahara. Make sure to add an odd number of nodes running JOURNALNODE processes with at least a number of 3 per CDH cluster. Unlike HDP, it is not necessary to go through the cluster template and enable the HDFSHA option in the template...