Book Image

Architecting Data-Intensive Applications

By : Anuj Kumar
Book Image

Architecting Data-Intensive Applications

By: Anuj Kumar

Overview of this book

<p>Are you an architect or a developer who looks at your own applications gingerly while browsing through Facebook and applauding it silently for its data-intensive, yet ?uent and efficient, behaviour? This book is your gateway to build smart data-intensive systems by incorporating the core data-intensive architectural principles, patterns, and techniques directly into your application architecture.</p> <p>This book starts by taking you through the primary design challenges involved with architecting data-intensive applications. You will learn how to implement data curation and data dissemination, depending on the volume of your data. You will then implement your application architecture one step at a time. You will get to grips with implementing the correct message delivery protocols and creating a data layer that doesn’t fail when running high traffic. This book will show you how you can divide your application into layers, each of which adheres to the single responsibility principle. By the end of this book, you will learn to streamline your thoughts and make the right choice in terms of technologies and architectural principles based on the problem at hand.</p>
Table of Contents (18 chapters)
Title Page
Packt Upsell
Contributors
Preface
Index

What do we mean by batch processing


Let's try to literally define batch processing:

  • Batch: Bringing similar (or related) things together
  • Processing: Performing some action or actions that results in the change of state

With that in mind, batch processing literally means performing actions on a group of things resulting in a new group of possibly different things.

If we look around us, we're doing things in batches without even realizing that we're doing it. Let's take making a smoothie for breakfast as an example. You typically bring together some fruits and/or vegetables, along with other ingredients, put them in a smoothie maker, and blend them together.

Now, if you look at the previous sentence, you realize that it fits perfectly into the definition of batch processing presented earlier.

Now, let's take the same approach and apply it in our daily IT work. When you perform a simple fictitious query like this:

SELECT user_name, dept_name from User, Dept WHERE user_id=1 and dept_id=1

You are essentially...