Book Image

OpenStack Sahara Essentials

By : Omar Khedher
Book Image

OpenStack Sahara Essentials

By: Omar Khedher

Overview of this book

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack. The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara. The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.
Table of Contents (14 chapters)

HDP high-availability support


Designing and deploying a high-availability cluster generally is a complicated task. When it comes to the big data world, ensuring a running Hadoop cluster that responds efficiently to sudden failures might require a lot of expertise and remain complex to troubleshoot, maintain, and join failed nodes to the cluster manually. The HDP defines in its native Hadoop stack architecture a few approaches to undertake the Hadoop high-availability limitation. By ensuring the availability of the nodes that are running the master services in a Hadoop cluster, such as the NameNode, any other dependent service will be able to coordinate with other nodes to fail over by pausing specific services and start to recover the connection to the failed node. There are few alternatives to guarantee a successful NameNode failover, which can be depicted in two common use cases as the following:

  • Using a VMware infrastructure (vSphere) by enabling the High Availability feature kit for the...