Book Image

Apache Mesos Essentials

By : Dharmesh Kakadia
Book Image

Apache Mesos Essentials

By: Dharmesh Kakadia

Overview of this book

<p>Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It allows developers to concurrently run the likes of Hadoop, Spark, Storm, and other applications on a dynamically shared pool of nodes. With Mesos, you have the power to manage a wide range of resources in a multi-tenant environment.</p> <p>Starting with the basics, this book will give you an insight into all the features that Mesos has to offer. You will first learn how to set up Mesos in various environments from data centers to the cloud. You will then learn how to implement self-managed Platform as a Service environment with Mesos using various service schedulers, such as Chronos, Aurora, and Marathon. You will then delve into the depths of Mesos fundamentals and learn how to build distributed applications using Mesos primitives.</p> <p>Finally, you will round things off by covering the operational aspects of Mesos including logging, monitoring, high availability, and recovery.</p>
Table of Contents (15 chapters)
Apache Mesos Essentials
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Resource isolation


Mesos provides various isolation mechanisms on slaves for sandboxing different tasks. The allocation of resources to one framework/job or user should not have any unintended effects on the running jobs. Containers act as lightweight virtual machines, providing the necessary isolation mechanism without the overhead of virtual machines. Using containers, we can limit the amount of resources that the process and all its child processes can access. To explain the detailed working of containers is beyond the scope of this book. However, to understand Mesos isolation mechanism, it is sufficient to assume that the containers provide a set of features that provide resource isolation.

Mesos resource isolation mechanism has a pluggable design and has evolved a lot since the creation of the project. The Mesos slave uses containerizer to provide an isolated environment to run an executor and its tasks. The following figure shows the different isolation mechanisms used by slaves.

Mesos...