Book Image

Apache Mesos Cookbook

By : David Blomquist, Tomasz Janiszewski
Book Image

Apache Mesos Cookbook

By: David Blomquist, Tomasz Janiszewski

Overview of this book

Apache Mesos is open source cluster sharing and management software. Deploying and managing scalable applications in large-scale clustered environments can be difficult, but Apache Mesos makes it easier with efficient resource isolation and sharing across application frameworks. The goal of this book is to guide you through the practical implementation of the Mesos core along with a number of Mesos supported frameworks. You will begin by installing Mesos and then learn how to configure clusters and maintain them. You will also see how to deploy a cluster in a production environment with high availability using Zookeeper. Next, you will get to grips with using Mesos, Marathon, and Docker to build and deploy a PaaS. You will see how to schedule jobs with Chronos. We’ll demonstrate how to integrate Mesos with big data frameworks such as Spark, Hadoop, and Storm. Practical solutions backed with clear examples will also show you how to deploy elastic big data jobs. You will find out how to deploy a scalable continuous integration and delivery system on Mesos with Jenkins. Finally, you will configure and deploy a highly scalable distributed search engine with ElasticSearch. Throughout the course of this book, you will get to know tips and tricks along with best practices to follow when working with Mesos.

Related Content you might be interested in

Current Title:

Small book image
Apache Mesos Cookbook
David Blomquist | Tomasz Janiszewski
Aug, 2017 | 146 pages
Small book image
Learn Apache Mesos
Manuj Aggarwal
Oct, 2018 | 248 pages
Small book image
Microservices Deployment Cookbook
Vikram Murugesan
Jan, 2017 | 378 pages
Small book image
Cloud Native Python
Manish Sethi
Jul, 2017 | 374 pages
Table of Contents (15 chapters)
Title Page
Title Page
Credits
Credits
About the Authors
About the Authors
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Getting Started with Apache Mesos
Getting Started with Apache Mesos
Introduction
Installing Mesos on Ubuntu 16.04 from packages
Installing Mesos on Ubuntu 14.04 from packages
Installing Mesos on CentOS 7 and RHEL 7 from packages
Preparing Ubuntu 16.04 for a Mesos installation from source code
Preparing Ubuntu 14.04 for a Mesos installation from source code
Preparing OS X (Yosemite and El Capitan) for a Mesos Installation from source code
Downloading, building, and installing the Mesos source code
2
Implementing High Availability with Apache ZooKeeper
Implementing High Availability with Apache ZooKeeper
Introduction
Configuring ZooKeeper installed from packages on Ubuntu 14.04, Ubuntu 16.04, CentOS 7, or RHEL 7
Configuring ZooKeeper on Ubuntu 14.04, 16.04, and OS X from source
3
Running and Maintaining Mesos
Running and Maintaining Mesos
Introduction
Logging and debugging
Monitoring
Setting attributes for agents
Defining roles and resources
Oversubscription
Controlling permissions using access control lists
Agent authentication
Encryption SSL
Upgrading Mesos
4
Understanding the Scheduler API
Understanding the Scheduler API
Introduction
Installing Protobuf
Registering frameworks
Handling events
Declining offers
Scheduling tasks
Acknowledging task updates
Killing tasks
State persistence
Reconciliation
5
Managing Containers
Managing Containers
Introduction
Enabling the Mesos containerizer
Enabling POSIX isolators
Enabling the POSIX disk isolator
Configuring the shared filesystem isolator
Configuring cgroup isolators
Configuring the port mapping network isolator
Configuring Docker image support for the Mesos containerizer
Using the Docker containerizer
Running an image from a private repository
Using container network interface
Monitoring containers with Sysdig
6
Deploying PaaS with Marathon
Deploying PaaS with Marathon
Introduction
Installing and configuring Marathon
Monitoring Marathon
Launching an application
Launching a Docker container
Setting up the discovery service
Enabling SSL
Enabling basic access authentication
Using a custom authentication plugin
Tuning Marathon
7
Job Scheduling with Metronome
Job Scheduling with Metronome
Introduction
Installing and configuring Metronome
Monitoring Metronome
Scheduling jobs
8
Continuous Integration with Jenkins
Continuous Integration with Jenkins
Introduction
Building the Jenkins Mesos plugin
Installing Jenkins
Enabling the Jenkins Mesos plugin

Enabling SSL

In this recipe, you will learn how to enable SSL for Marathon to protect eavesdropping on Marathon communication.

Getting ready

First, we need to create a place for our Java keystore:

mkdir -p /etc/marathon/ssl
cd /etc/marathon/ssl

Then, put the keystore password into the environment variable. We will need it later:

export MARATHON_SSL_KEYSTORE_PASSWORD=jks_pass

Generate the keystore. In this example, we will use self-signed certificates but if you can issue an organization-wide trusted certificate, it would be better to use that. With self- signed certificates, most browsers will mark the Marathon UI and API as dangerous and there is a chance that somebody will create a man-in-the-middle attack:

keytool -keystore marathon.jks -deststorepass $MARATHON_SSL_KEYSTORE_PASSWORD -alias marathon -genkey -keyalg RSA

How to do it...

Finally, save the Marathon keystore configuration:

cat << EOF > /etc/default/marathon
MARATHON_SSL_KEYSTORE_PATH=/etc/marathon/ssl/marathon.jks
MARATHON_SSL_KEYSTORE_PASSWORD...
Previous Section
End of Section 8
Next Section