Book Image

Apache Mesos Essentials

By : Dharmesh Kakadia
Book Image

Apache Mesos Essentials

By: Dharmesh Kakadia

Overview of this book

<p>Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It allows developers to concurrently run the likes of Hadoop, Spark, Storm, and other applications on a dynamically shared pool of nodes. With Mesos, you have the power to manage a wide range of resources in a multi-tenant environment.</p> <p>Starting with the basics, this book will give you an insight into all the features that Mesos has to offer. You will first learn how to set up Mesos in various environments from data centers to the cloud. You will then learn how to implement self-managed Platform as a Service environment with Mesos using various service schedulers, such as Chronos, Aurora, and Marathon. You will then delve into the depths of Mesos fundamentals and learn how to build distributed applications using Mesos primitives.</p> <p>Finally, you will round things off by covering the operational aspects of Mesos including logging, monitoring, high availability, and recovery.</p>
Table of Contents (15 chapters)
Apache Mesos Essentials
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Service discovery


When we are running multiple copies of your application, we should have the ability to discover where they are running and should be able to connect to them. This is especially important in case of failures, where Mesos relaunches services on other machines, but clients should still be able to connect. There are two popular ways to discover services:

  • Domain Name Service based

  • Specialized service discovery solutions (ZooKeeper, Consul, Serf, SkyDNS, and so on)

Domain Name Service (DNS) based discovery is very general and thus, it is easier to integrate with a lot of tools, while specialized solutions require understanding different framework-specific APIs. On the other hand, with DNS-based discovery methods, it might be harder to provide richer information about services, while specific solutions can provide extra information regarding service health and load. We will cover one DNS-based service discovery mechanism here—Mesos-DNS, but there are other service discovery solutions...