Kappa architecture
The idea behind Kappa architecture is based on the notion that the entire dataset is a stream that can be read any number of times by the underlying system to perform computations on it. The data store in a Kappa architecture is an append-only immutable logging system. Data is read from this immutable store by various computational systems that perform computations on the data in a Directed manner and this computed data ends up in a Serving store where the queries get executed.
You may have noticed that Kappa architecture is a simplification of the lambda architecture, where we have simply removed the entire Batch Layer and replaced everything with a Streaming layer.
At the center of Kappa architecture is the immutable data log. This is similar in concept to the immutable Master Dataset in Lambda architecture, but instead of using technologies such as Hadoop/HDFS, Kappa architecture's immutable data log is (usually) Kafka. Apache kafka is a system developed at LinkedIn that...