So far, Clever Coney Media has used only RabbitMQ in the context of its main user-facing application. However, others in the company are interested in benefiting from message queuing. If you remember the overview of the architecture that was introduced in Chapter 1, A Rabbit Springs to Life, CCM uses Python to perform a data analysis of the user data stored in the different databases being used in the company. The team that is in charge of internal analytics has been looking for an elegant solution to aggregate logs from different applications in order to roll out new statistics, both for internal and end-user consumption.

Taking its interoperable nature into account, CCM thinks that AMQP is the perfect fit for this need; the idea is to publish logs from all applications to RabbitMQ and then use Python to consume, persist, slice, and then dice this data. The following diagram illustrates the architecture it has in mind:

The log analysis architecture

There are two...