Book Image

Apache Kafka 1.0 Cookbook

By : Alexey Zinoviev, Raúl Estrada
Book Image

Apache Kafka 1.0 Cookbook

By: Alexey Zinoviev, Raúl Estrada

Overview of this book

Apache Kafka provides a unified, high-throughput, low-latency platform to handle real-time data feeds. This book will show you how to use Kafka efficiently, and contains practical solutions to the common problems that developers and administrators usually face while working with it. This practical guide contains easy-to-follow recipes to help you set up, configure, and use Apache Kafka in the best possible manner. You will use Apache Kafka Consumers and Producers to build effective real-time streaming applications. The book covers the recently released Kafka version 1.0, the Confluent Platform and Kafka Streams. The programming aspect covered in the book will teach you how to perform important tasks such as message validation, enrichment and composition.Recipes focusing on optimizing the performance of your Kafka cluster, and integrate Kafka with a variety of third-party tools such as Apache Hadoop, Apache Spark, and Elasticsearch will help ease your day to day collaboration with Kafka greatly. Finally, we cover tasks related to monitoring and securing your Apache Kafka cluster using tools such as Ganglia and Graphite. If you're looking to become the go-to person in your organization when it comes to working with Apache Kafka, this book is the only resource you need to have.
Table of Contents (18 chapters)
Title Page
Credits
About the Author
About the Reviewers
www.PacktPub.com
Customer Feedback
Dedication
Preface

Using the Kafka REST Proxy


What happens if we want to use Kafka in an environment that is not yet supported? Think in terms of something such as JavaScript, PHP, and so on.

For this and other programming challenges, the Kafka REST Proxy provides a RESTful interface to a Kafka cluster.

From a REST interface, one can produce and consume messages, view the state of the cluster, and perform administrative actions without using the native Kafka protocol or clients.

The example use cases are:

  • Sending data to Kafka from a frontend app built in a non-supported language (yes, think of the JavaScript and PHP fronts, for example).
  • The need to communicate with Kafka from an environment that doesn't support Kafka (think in terms of mainframes and legacy systems).
  • Scripting administrative actions. Think of a DevOps team in charge of a Kafka system and a sysadmin who doesn't know the supported languages (Java, Scala, Python, Go, or C/C++).

Getting ready

The Confluent Platform should be up and running:

$ confluent...