Book Image

Native Docker Clustering with Swarm

By : Fabrizio Soppelsa, Chanwit Kaewkasi
Book Image

Native Docker Clustering with Swarm

By: Fabrizio Soppelsa, Chanwit Kaewkasi

Overview of this book

Docker Swarm serves as one of the crucial components of the Docker ecosystem and offers a native solution for you to orchestrate containers. It’s turning out to be one of the preferred choices for Docker clustering thanks to its recent improvements. This book covers Swarm, Swarm Mode, and SwarmKit. It gives you a guided tour on how Swarm works and how to work with Swarm. It describes how to set up local test installations and then moves to huge distributed infrastructures. You will be shown how Swarm works internally, what’s new in Swarmkit, how to automate big Swarm deployments, and how to configure and operate a Swarm cluster on the public and private cloud. This book will teach you how to meet the challenge of deploying massive production-ready applications and a huge number of containers on Swarm. You'll also cover advanced topics that include volumes, scheduling, a Libnetwork deep dive, security, and platform scalability.
Table of Contents (18 chapters)
Native Docker Clustering with Swarm
Credits
About the Authors
About the Reviewer
www.PacktPub.com
Dedication
Preface

An HA Topology for Swarm2k


Swarm2k and Swarm3k were collaborative experiments. We raised funds in terms of Docker Hosts, instead of money, with a call to participate. The result was astonishing-Swarm2k and Swarm3k were joined by dozens of individuals and corporate geographically distributed contributors. In total, for Swarm2k, we collected around 2,300 nodes, while for Swarm3k, around 4,700.

Let's discuss the architecture of Swarm2k. In the preceding figure, there are three managers, denoted as mg0, mg1, and mg2. We will use the three managers because it is the optimum number of managers, suggested by the Docker core team. Managers formed a quorum on a high-speed network link and raft nodes employ employed a significant amount of resources to synchronize their activities. So, we decided to deploy our managers on a 40GB Ethernet link into the same data center.

At the beginning of the experiment, we had the following configuration:

  • mg0 was the cluster's manager leader

  • mg1 hosted the stat collector...