Book Image

Apache Mesos Cookbook

By : Marco Massenzio, Blomquist, Tomasz Janiszewski
Book Image

Apache Mesos Cookbook

By: Marco Massenzio, Blomquist, Tomasz Janiszewski

Overview of this book

Apache Mesos is open source cluster sharing and management software. Deploying and managing scalable applications in large-scale clustered environments can be difficult, but Apache Mesos makes it easier with efficient resource isolation and sharing across application frameworks. The goal of this book is to guide you through the practical implementation of the Mesos core along with a number of Mesos supported frameworks. You will begin by installing Mesos and then learn how to configure clusters and maintain them. You will also see how to deploy a cluster in a production environment with high availability using Zookeeper. Next, you will get to grips with using Mesos, Marathon, and Docker to build and deploy a PaaS. You will see how to schedule jobs with Chronos. We’ll demonstrate how to integrate Mesos with big data frameworks such as Spark, Hadoop, and Storm. Practical solutions backed with clear examples will also show you how to deploy elastic big data jobs. You will find out how to deploy a scalable continuous integration and delivery system on Mesos with Jenkins. Finally, you will configure and deploy a highly scalable distributed search engine with ElasticSearch. Throughout the course of this book, you will get to know tips and tricks along with best practices to follow when working with Mesos.
Table of Contents (9 chapters)

Enabling the POSIX disk isolator


The POSIX disk isolator does not perform isolation like a POSIX isolator. It monitors and limits resources by killing tasks that exceed a given quota. In this recipe, you will learn how to limit applications to the size of each sandbox.

Getting ready

You need to have Mesos up and running. See the recipes of Chapter 1, Getting Started with Apache Mesos to get more information.

How to do it...

To enable the POSIX disk isolator, we need to append disk/du to the isolators list:

echo "disk/du" > /etc/mesos-slave/isolation

This will enable periodic checking of the sandbox size. To enforce a kill policy on tasks that reach their limit, we need to explicitly turn it on:

touch /etc/mesos-slave/enforce_container_disk_quota

Mesos will now check all sandbox sizes with du and kill one if it uses more disk space than the allocated limit. To change this interval to 5 minutes, use following code:

echo "5mins" > /etc/mesos-slave/container_disk_watch_interval

How it works...

Similar...