The volume of data created by mankind is increasing massively. In the last two years, we have created more data than in the previous history of the human race—unstructured data grows every second. This is why new paradigms must be used to properly manage it.
The term big data is used more and more frequently, but what exactly is big data? How big is big data? It all depends on the perspective. Imagine a small company that works with spreadsheets accumulating data every year to the point where this tool is no longer useful. The company needs a new strategy such as relational databases and ERP software.
This same analogy works for big companies. Big data is using non-traditional methods to analyze vast amounts of information from different sources and types. Latency plays an important role in the big-data pipeline, because, depending on...