Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Mastering Mesos
  • Table Of Contents Toc
Mastering Mesos

Mastering Mesos

By : Dipa Dubhashi, Akhil Das
3 (2)
close
close
Mastering Mesos

Mastering Mesos

3 (2)
By: Dipa Dubhashi, Akhil Das

Overview of this book

Apache Mesos is open source cluster management software that provides efficient resource isolations and resource sharing distributed applications or frameworks. This book will take you on a journey to enhance your knowledge from amateur to master level, showing you how to improve the efficiency, management, and development of Mesos clusters. The architecture is quite complex and this book will explore the difficulties and complexities of working with Mesos. We begin by introducing Mesos, explaining its architecture and functionality. Next, we provide a comprehensive overview of Mesos features and advanced topics such as high availability, fault tolerance, scaling, and efficiency. Furthermore, you will learn to set up multi-node Mesos clusters on private and public clouds. We will also introduce several Mesos-based scheduling and management frameworks or applications to enable the easy deployment, discovery, load balancing, and failure handling of long-running services. Next, you will find out how a Mesos cluster can be easily set up and monitored using the standard deployment and configuration management tools. This advanced guide will show you how to deploy important big data processing frameworks such as Hadoop, Spark, and Storm on Mesos and big data storage frameworks such as Cassandra, Elasticsearch, and Kafka.
Table of Contents (11 chapters)
close
close
10
Index

Building a custom framework on Mesos


As we already know, a Mesos framework is an application running on Mesos. In this module, we will see how we can create our own Mesos framework. For the sake of simplicity, we will create a simple Java application to calculate the value of pi. A Mesos framework consists of the following three components:

  • Driver: This is the piece of code that submits tasks to the framework

  • Executor: This is the piece of code that is launched on the Mesos slave nodes to run the framework's tasks

  • Scheduler: This is the piece of code that registers with the master, asks for resources from it, and runs tasks on the executor

Now, let's take a look at how we can develop each of these components to build a custom Mesos framework in the following sections.

Driver implementation

The driver program is the one that creates the executor information. The executor information consists of an executorID being a String value and a command that is executed through the Linux /bin/sh-c command...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Mastering Mesos
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon