Book Image

Architecting Data-Intensive Applications

By : Anuj Kumar
Book Image

Architecting Data-Intensive Applications

By: Anuj Kumar

Overview of this book

<p>Are you an architect or a developer who looks at your own applications gingerly while browsing through Facebook and applauding it silently for its data-intensive, yet ?uent and efficient, behaviour? This book is your gateway to build smart data-intensive systems by incorporating the core data-intensive architectural principles, patterns, and techniques directly into your application architecture.</p> <p>This book starts by taking you through the primary design challenges involved with architecting data-intensive applications. You will learn how to implement data curation and data dissemination, depending on the volume of your data. You will then implement your application architecture one step at a time. You will get to grips with implementing the correct message delivery protocols and creating a data layer that doesn’t fail when running high traffic. This book will show you how you can divide your application into layers, each of which adheres to the single responsibility principle. By the end of this book, you will learn to streamline your thoughts and make the right choice in terms of technologies and architectural principles based on the problem at hand.</p>
Table of Contents (18 chapters)
Title Page
Packt Upsell
Contributors
Preface
Index

Chapter 8. Challenges of Data Processing

In today's world, everyone is interacting with huge amounts of data almost daily without even realizing it. Be it watching a Netflix Series, YouTube videos, reading news online, WhatsApp messaging, or even making a phone call, everything is connected to data. Now imagine for a moment that you tune into Netflix to watch your favorite series and suddenly you see some random, unedited, unprocessed video where the cameramen, crew, and the director are randomly trying to shoot some scenes. Your first reaction would probably be, "What is this? Why is the video in such a non-consumable format?" and your second reaction would be to tweet about it, and your third would be to move away from the content.

The second and third reactions cause more data to be available for others to consume. For example, companies such as Netflix and other dedicated content providers are very interested in knowing how much time you spend on which content, the usual time you watch...