-
Book Overview & Buying
-
Table Of Contents
Getting Started with Taipy
By :
The term big data gained prominence in the 2010s as companies collected data that was too large for traditional methods. It’s defined by the 3 Vs: volume (large amounts), velocity (high-speed generation), and variety (diverse formats such as images and videos). Not all three Vs must be present for a problem to be considered big data; for example, other scenarios include large-scale sensor networks generating continuous streams of uniform readings, clickstream analysis from millions of web users, or scientific simulations producing petabytes of homogeneous results. High-frequency trading involves massive, fast-processed structured data but lacks variety. These challenges led to specialized solutions such as NoSQL databases (e.g., MongoDB) and parallel computing frameworks such as Hadoop and Spark.
This chapter explores how applications handle large data, which is a relative term. For instance, in one case, plotting 100,000 points can...