Book Image

Microservices Deployment Cookbook

By : Vikram Murugesan
Book Image

Microservices Deployment Cookbook

By: Vikram Murugesan

Overview of this book

This book will help any team or organization understand, deploy, and manage microservices at scale. It is driven by a sample application, helping you gradually build a complete microservice-based ecosystem. Rather than just focusing on writing a microservice, this book addresses various other microservice-related solutions: deployments, clustering, load balancing, logging, streaming, and monitoring. The initial chapters offer insights into how web and enterprise apps can be migrated to scalable microservices. Moving on, you’ll see how to Dockerize your application so that it is ready to be shipped and deployed. We will look at how to deploy microservices on Mesos and Marathon and will also deploy microservices on Kubernetes. Next, you will implement service discovery and load balancing for your microservices. We’ll also show you how to build asynchronous streaming systems using Kafka Streams and Apache Spark. Finally, we wind up by aggregating your logs in Kafka, creating your own metrics, and monitoring the metrics for the microservice.
Table of Contents (15 chapters)
Microservices Deployment Cookbook
Credits
About the Author
About the Reviewer
www.PacktPub.com
Customer Feedback
Preface

Integrating Kafka with log management systems


In the previous recipe, we learned how to consolidate log messages from microservices into a Kafka topic using Log4J2 and Kafka. In this recipe, we will look at various options that we have to visualize our logs. There are several log-management systems available in the market at the moment. We will talk about few of them in this recipe.

How it works...

There are several log-management tools, such as Splunk, Graylog2, and Loggly. Most of them nowadays come with a Kafka listener. However, at the time of writing this, Splunk does not have an official Kafka consumer. There are several third-partly plugins that you can install with Splunk to consume messages from Kafka topics.Graylog2 is another popular log-management tool that has picked up traction lately mostly because it is open source. It comes packed with tons of features. Though the interface is not very sophisticated, it gets the job done well. Graylog came with their own log format called...