Apache Kafka is an open source message streaming platform that allows you to publish, subscribe, stream, and process millions of data in real time. Since IoT Event Data is in millions, the Apache Kafka platform can be used to process and transform streaming data. It is also a distributed system and is designed to be fault tolerant. Salesforce IoT Cloud (Thunder) is built using Apache Kafka.
The streams of data are divided into topics in Kafka. It is run as a cluster on one or more servers, and has four core APIs, as shown in the following table:
|Producer API||This allows other applications to publish record streams to Kafka topics.|
|Consumer API||This allows applications...|