Book Image

Learning Apache Kafka - Second Edition

By : Nishant Garg
Book Image

Learning Apache Kafka - Second Edition

By: Nishant Garg

Overview of this book

<p>Kafka is one of those systems that is very simple to describe at a high level but has an incredible depth of technical detail when you dig deeper.</p> <p>Learning Apache Kafka Second Edition provides you with step-by-step, practical examples that help you take advantage of the real power of Kafka and handle hundreds of megabytes of messages per second from multiple clients. This book teaches you everything you need to know, right from setting up Kafka clusters to understanding basic blocks like producer, broker, and consumer blocks. Once you are all set up, you will then explore additional settings and configuration changes to achieve ever more complex goals. You will also learn how Kafka is designed internally and what configurations make it more effective. Finally, you will learn how Kafka works with other tools such as Hadoop, Storm, and so on.</p>

Related Content you might be interested in

Current Title:

Small book image
Learning Apache Kafka - Second Edition
Nishant Garg
Feb, 2015 | 112 pages
No titles found
Table of Contents (14 chapters)
Learning Apache Kafka Second Edition
Learning Apache Kafka Second Edition
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Introducing Kafka
Introducing Kafka
Welcome to the world of Apache Kafka
Why do we need Kafka?
Kafka use cases
Installing Kafka
Summary
2
Setting Up a Kafka Cluster
Setting Up a Kafka Cluster
A single node – a single broker cluster
A single node – multiple broker clusters
Multiple nodes – multiple broker clusters
The Kafka broker property list
Summary
3
Kafka Design
Kafka Design
Kafka design fundamentals
Log compaction
Message compression in Kafka
Replication in Kafka
Summary
4
Writing Producers
Writing Producers
The Java producer API
Simple Java producers
Creating a Java producer with custom partitioning
The Kafka producer property list
Summary
5
Writing Consumers
Writing Consumers
Kafka consumer APIs
Simple Java consumers
Reading messages from a topic and printing them
Multithreaded Java consumers
The Kafka consumer property list
Summary
6
Kafka Integrations
Kafka Integrations
Kafka integration with Storm
Introducing Storm
Kafka integration with Hadoop
Summary
7
Operationalizing Kafka
Operationalizing Kafka
Kafka administration tools
Kafka cluster mirroring
Integration with other tools
Summary
Index
Index

About the Author

Nishant Garg has over 14 years of software architecture and development experience in various technologies, such as Java Enterprise Edition, SOA, Spring, Hadoop, Hive, Flume, Sqoop, Oozie, Spark, Shark, YARN, Impala, Kafka, Storm, Solr/Lucene, NoSQL databases (such as HBase, Cassandra, and MongoDB), and MPP databases (such as GreenPlum).

He received his MS in software systems from the Birla Institute of Technology and Science, Pilani, India, and is currently working as a technical architect for the Big Data R&D Group with Impetus Infotech Pvt. Ltd. Previously, Nishant has enjoyed working with some of the most recognizable names in IT services and financial industries, employing full software life cycle methodologies such as Agile and SCRUM.

Nishant has also undertaken many speaking engagements on big data technologies and is also the author of HBase Essestials, Packt Publishing.

I would like to thank my parents (Mr. Vishnu Murti Garg and Mrs. Vimla Garg) for their continuous encouragement and motivation throughout my life. I would also like to thank my wife (Himani) and my kids (Nitigya and Darsh) for their never-ending support, which keeps me going.

Finally, I would like to thank Vineet Tyagi, CTO and Head of Innovation Labs, Impetus, and Dr. Vijay, Director of Technology, Innovation Labs, Impetus, for encouraging me to write.

Previous Section
Next Chapter