Kafka contributors are still working on performance testing, and their goal is to produce a number of script files that help in running the performance tests. Some of them are provided in the Kafka bin
folder:
Kafka-producer-perf-test.sh
: This script will run thekafka.perf.ProducerPerformance
class to produce the incremented statistics into a CSV file for the producersKafka-consumer-perf-test.sh
: This script will run thekafka.perf.ConsumerPerformance
class to produce the incremented statistics into a CSV file for the consumers
Some more scripts for pulling the Kafka server and ZooKeeper statistics are provided in the CSV format. Once CSV files are produced, the R script can be created to produce the graph images.
Note
For detailed information on how to go for Kafka performance testing, please refer to https://cwiki.apache.org/confluence/display/KAFKA/Performance+testing.