Book Image

Apache Mesos Essentials

By : Dharmesh Kakadia
Book Image

Apache Mesos Essentials

By: Dharmesh Kakadia

Overview of this book

<p>Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It allows developers to concurrently run the likes of Hadoop, Spark, Storm, and other applications on a dynamically shared pool of nodes. With Mesos, you have the power to manage a wide range of resources in a multi-tenant environment.</p> <p>Starting with the basics, this book will give you an insight into all the features that Mesos has to offer. You will first learn how to set up Mesos in various environments from data centers to the cloud. You will then learn how to implement self-managed Platform as a Service environment with Mesos using various service schedulers, such as Chronos, Aurora, and Marathon. You will then delve into the depths of Mesos fundamentals and learn how to build distributed applications using Mesos primitives.</p> <p>Finally, you will round things off by covering the operational aspects of Mesos including logging, monitoring, high availability, and recovery.</p>
Table of Contents (15 chapters)
Apache Mesos Essentials
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Chronos


Marathon make it possible to run long-running services. Another important piece of infrastructure is the recurring jobs. Typical enterprises run dozens of jobs that do not need to always be running but have to be triggered at a particular time repeatedly, such as backups, Extract-Transform-Load (ETL) jobs, running other frameworks, and so on.

The repeated execution functionality has been traditionally achieved via cron utility and shell scripts. This is not only error prone and difficult to maintain, but is also not reliable. If the node on which the cron job is scheduled dies, the job will not be executed and the enterprise workflow might halt. Chronos (https://github.com/mesos/chronos) is a fault-tolerant job scheduler that handles dependencies and ISO8601-based schedules and acts as a cron for the Mesos data center kernel. ISO8601 is an international standard used to represent and exchange date and time-related data. Chronos uses ZooKeeper to achieve fault tolerance and relies...