Chapter 12. When Data Dissemination is as Important as Data Itself
In the last 11 chapters, we have been through a journey exploring the data ecosystem, trying to define a reference architecture for a data intensive system that consisted of lots of micro services working in a decoupled manner and interacting with each other using an event-driven mechanism and a data pipeline. We looked at various data processing use cases of batch processing and stream processing. We also discussed data storage solutions for huge datasets. But if I tell you that all this will fail if you don't get your dissemination architecture right, you will probably frown at me. It's a hard-to-digest fact.
In this chapter, we will look at the following topics:
- Dissemination architecture and what problem it tries to solve
- Planning a dissemination architecture, including what you should keep in mind when defining a dissemination architecture
- Various technical and architectural approaches that enable an efficient and resilient...