Book Image

Architecting Data-Intensive Applications

By : Anuj Kumar
Book Image

Architecting Data-Intensive Applications

By: Anuj Kumar

Overview of this book

<p>Are you an architect or a developer who looks at your own applications gingerly while browsing through Facebook and applauding it silently for its data-intensive, yet ?uent and efficient, behaviour? This book is your gateway to build smart data-intensive systems by incorporating the core data-intensive architectural principles, patterns, and techniques directly into your application architecture.</p> <p>This book starts by taking you through the primary design challenges involved with architecting data-intensive applications. You will learn how to implement data curation and data dissemination, depending on the volume of your data. You will then implement your application architecture one step at a time. You will get to grips with implementing the correct message delivery protocols and creating a data layer that doesn’t fail when running high traffic. This book will show you how you can divide your application into layers, each of which adheres to the single responsibility principle. By the end of this book, you will learn to streamline your thoughts and make the right choice in terms of technologies and architectural principles based on the problem at hand.</p>
Table of Contents (18 chapters)
Title Page
Packt Upsell
Contributors
Preface
Index

Chapter 12. When Data Dissemination is as Important as Data Itself

In the last 11 chapters, we have been through a journey exploring the data ecosystem, trying to define a reference architecture for a data intensive system that consisted of lots of micro services working in a decoupled manner and interacting with each other using an event-driven mechanism and a data pipeline. We looked at various data processing use cases of batch processing and stream processing. We also discussed data storage solutions for huge datasets. But if I tell you that all this will fail if you don't get your dissemination architecture right, you will probably frown at me. It's a hard-to-digest fact.

In this chapter, we will look at the following topics:

  • Dissemination architecture and what problem it tries to solve
  • Planning a dissemination architecture, including what you should keep in mind when defining a dissemination architecture
  • Various technical and architectural approaches that enable an efficient and resilient...