Setting up orchestration for a Docker cluster is only half the battle. One also needs visibility into the cluster. Why is data retrieval slow? Is it disk or network? What is being logged by the web server for an application? How much memory is being used by an application? At some point, these or similar questions will come up and it will be up to you, as the administrator, to have the answers for these.
This chapter will look at different tools that can be deployed to assist in monitoring and troubleshooting. Some, such as Kibana, can provide a summary of the cluster health while others, such as Sysdig, can provide deep dive information on applications or individual containers.
This chapter will cover the following topics:
Docker logging drivers
Logging for containers that do not send logs to standard out or standard error
Logging and viewing logs with the ELK stack
Using remote logging with Kubernetes, Mesosphere, and Docker Datacenter