These are the settings you need to configure if you want to get the best performance out of your Kafka producer.
You can start by editing the producer.properties file in the config folder of your Kafka installation. This is another key value pair file which you can open to edit in your favorite text editor.
Proceed with the following steps to configure the thread and performance for producer:
You can set the
producer.typevalue:producer.type=syncSet the
serializer.classvalue:serializer.class=kafka.serializer.DefaultEncoderSet the
key.serializer.classvalue:key.serializer.class=kafka.serializer.DefaultEncoderSet the
partitioner.classvalue:partitioner.class=kafka.producer.DefaultPartitionerSet the
compression.codecvalue:compression.codec=noneSet the
compressed.topicsvalue:compressed.topics=mytesttopiclSet the
message.send.max.retriesvalue:message.send.max.retries=3Set the
retry.backoff.msvalue...