Book Image

Native Docker Clustering with Swarm

By : Fabrizio Soppelsa, Chanwit Kaewkasi
Book Image

Native Docker Clustering with Swarm

By: Fabrizio Soppelsa, Chanwit Kaewkasi

Overview of this book

Docker Swarm serves as one of the crucial components of the Docker ecosystem and offers a native solution for you to orchestrate containers. It’s turning out to be one of the preferred choices for Docker clustering thanks to its recent improvements. This book covers Swarm, Swarm Mode, and SwarmKit. It gives you a guided tour on how Swarm works and how to work with Swarm. It describes how to set up local test installations and then moves to huge distributed infrastructures. You will be shown how Swarm works internally, what’s new in Swarmkit, how to automate big Swarm deployments, and how to configure and operate a Swarm cluster on the public and private cloud. This book will teach you how to meet the challenge of deploying massive production-ready applications and a huge number of containers on Swarm. You'll also cover advanced topics that include volumes, scheduling, a Libnetwork deep dive, security, and platform scalability.
Table of Contents (18 chapters)
Native Docker Clustering with Swarm
Credits
About the Authors
About the Reviewer
www.PacktPub.com
Dedication
Preface

Backing up the cluster configuration


The important data on managers is stored in /var/lib/docker/swarm. Here we have:

  • The certificates in certificates/

  • The Raft status with Etcd logs and snapshots in raft/

  • The tasks database in worker/

  • Other less crucial information, such as the current manager status, the current connection socket, and so on.

It's a good idea to set up a periodical backup of this data, in case recovery is needed.

The space used by the Raft log depends on the number of tasks spawned onto the cluster and on how frequently their states change. For 200,000 containers, the Raft log can grow up to around 1GB of disk space every three hours. A log entry of each task occupies around 5 KB. Consequently, the log rotation policies for the Raft log directory, /var/lib/docker/swarm/raft, should be calibrated more or less aggressively, which depends on the available disk space.