Book Image

Apache Mesos Essentials

By : Dharmesh Kakadia
Book Image

Apache Mesos Essentials

By: Dharmesh Kakadia

Overview of this book

<p>Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It allows developers to concurrently run the likes of Hadoop, Spark, Storm, and other applications on a dynamically shared pool of nodes. With Mesos, you have the power to manage a wide range of resources in a multi-tenant environment.</p> <p>Starting with the basics, this book will give you an insight into all the features that Mesos has to offer. You will first learn how to set up Mesos in various environments from data centers to the cloud. You will then learn how to implement self-managed Platform as a Service environment with Mesos using various service schedulers, such as Chronos, Aurora, and Marathon. You will then delve into the depths of Mesos fundamentals and learn how to build distributed applications using Mesos primitives.</p> <p>Finally, you will round things off by covering the operational aspects of Mesos including logging, monitoring, high availability, and recovery.</p>
Table of Contents (15 chapters)
Apache Mesos Essentials
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Advanced topics


We have seen how to implement a very simple framework on Mesos. Real-world frameworks rarely are so simple. In this section, we will briefly discuss some advanced topics and note down some precautions.

Reconciliation

Mesos does a great a job with hiding the nuances of building distributed applications and provides a simpler API. Although, Mesos provides a reliable communication mechanism for framework developers, the fact that the frameworks are distributed systems cannot always be ignored. Mesos has an actor-like programming model with message-passing, with a mix of at-most-once and at-least-once semantics. The messaging between the master and framework can have failures and lost messages. When this happens, the worldview of the framework and master will be out of sync. An example scenario would be where the framework sends a message to the master and the master dies before receiving the message or before sending the message to the slave. So the task assumes that the master...