Finally, the third cluster configuration is multiple-node multiple-broker (MNMB). This cluster is used when there are several nodes and one or many brokers per node.
Go to the Kafka installation directory (/usr/local/kafka/
for macOS users and /opt/kafka/
for Linux users):
> cd /usr/local/kafka
The following diagram shows an example MNMB cluster:
Here we are presented with the real power of the cluster. In this cluster, Kafka should be installed on every machine in the cluster. Here, every physical server could have one or many brokers; all the nodes on the same cluster should connect to the same ZooKeeper.
The good news is that all the commands in the previous recipes remain the same. The commands for ZooKeeper, the broker, producer, and consumer, don't change.
- The complete list of important properties of Kafka brokers is at: http://kafka.apache.org/documentation.html#brokerconfigs...