Book Image

Extending OpenStack

By : Omar Khedher
Book Image

Extending OpenStack

By: Omar Khedher

Overview of this book

OpenStack is a very popular cloud computing platform that has enabled several organizations during the last few years to successfully implement their Infrastructure as a Service (IaaS) platforms. This book will guide you through new features of the latest OpenStack releases and how to bring them into production straightaway in an agile way. It starts by showing you how to expand your current OpenStack setup and how to approach your next OpenStack Data Center generation deployment. You will discover how to extend your storage and network capacity and also take advantage of containerization technology such as Docker and Kubernetes in OpenStack. Additionally, you'll explore the power of big data as a Service terminology implemented in OpenStack by integrating the Sahara project. This book will teach you how to build Hadoop clusters and launch jobs in a very simple way. Then you'll automate and deploy applications on top of OpenStack. You will discover how to write your own plugin in the Murano project. The final part of the book will go through best practices for security such as identity, access management, and authentication exposed by Keystone in OpenStack. By the end of this book, you will be ready to extend and customize your private cloud based on your requirements.
Table of Contents (12 chapters)

Deploying the Hadoop cluster

The Sahara project follows the same extensibility fashion as other OpenStack projects using the plugin terminology. Depending on which data processing framework a user or cloud operator would use, Sahara offers different sets of distributions by means of provisioning plugins. At the time of writing of this book, Sahara allows the provisioning of any data processing framework supporting one of the following vendors in OpenStack:

  • Vanilla: Vanilla Apache Hadoop
  • HDP: Hortonworks Data Platform
  • MapR Distribution: MapR Filesystem (MapR-FS)
  • Cloudera: Cloudera Hadoop
  • Spark: Apache Spark

It is important to keep in mind that within every new OpenStack release, there are new, updated plugin versions. For the current setup, we keep using the Ocata release, supporting the following Sahara plugin versions:

# openstack dataprocessing plugin list  

In the following...