Making sense of the data
And truly that is it. There is nothing more to it. If you have been in the business of data processing, you would say: I know that is the only thing we are doing, but the phrase making sense is so diverse and sometimes difficult to interpret, that it is almost impossible to get it right the first time.
This chapter is part of Chapter 3, Patterns of the Data Intensive Architecture. It is a discussion on data processing, its challenges in the big data world, and ways to approach the data processing system's architecture and design. In this chapter, we will focus on the challenges that surround data processing use cases and try to give the readers as broad a perspective as possible on what data processing is and what it is not.
What is data processing?
If you haven't already figured it out or if you want a PowerPoint definition of data processing, then you are in luck. Data processing, as the term suggests, is a set of intertwined functions performed on pieces of data...