Big data describes datasets too large or complex for traditional tools. The volume is one dimension. Velocity is another: data arriving in real time from sensors, logs, and clickstreams. Variety covers the mix of structured tables, unstructured text, images, and video. The three V's have been the standard definition for years. Some add veracity, the question of whether the data is trustworthy.

The tools evolved to handle the scale. Hadoop distributed storage and processing across commodity servers. Spark added in-memory computation for speed. NoSQL databases handled unstructured data that relational systems struggled with. Cloud platforms turned big data infrastructure into a service. The hype peaked around 2015. Every company wanted a data lake. Many built them and never used the data. The technology works. The hard part is asking the right questions and having the skills to answer them. Big data is not valuable because it is big. It is valuable when it reveals something a smaller dataset would miss. Most of the time, a well-designed sample beats a messy full dataset.

The dimensions of big data

• Volume — terabytes to petabytes
• Velocity — real-time or near-real-time streams
• Variety — structured, semi-structured, and unstructured
• Veracity — accuracy and trustworthiness
• Value — insights that justify the cost

Big data is a tool, not a goal. The goal is better decisions. Size alone does not deliver them.