Azure Event Hubs Capture feature
There is one feature of Azure Event Hubs that requires an individual section itself to describe it in depth. Capture is a functionality that allows you to automatically store events using a predefined storage solution (such as Azure Storage or Azure Data Lake) and process them further. Unfortunately, this feature is often misused as its use cases are not so obvious; additionally, the way it works might sometimes be unclear.
What is an Azure Event Hubs Capture?
In common use cases for Event Hubs, you need a producer and a consumer to fetch data and process it. Let’s consider the following scenario:
Figure 13.18 – Multiple processing flows for Azure Event Hubs
In this scenario, we have two consumers:
- Consumer 1 for some generic processing
- Consumer 2 for archiving events
Additionally, we introduced storage for...