Blog > May 2017 > Mass Data Consumption: The Rapid Evolution of Human Knowledge

Mass Data Consumption: The Rapid Evolution of Human Knowledge

We live in a digital age. Successful companies and data scientists are able to effectively use available data and draw value out of it. Over the last decade, companies have been progressively embracing this idea and implementing different strategies to harvest and transform their information. It’s gotten to a point where some corporate data paths have become intensely complex, leaving the door open to errors, complexity and slower corrective measures.

In order to evolve and survive in the new age, companies now need to master data management, discover new ways to leverage their data pool and, in some cases, create new business opportunities from corporate information. Before they can do that, they need to ensure their data is reliable, understand where in the data food chain its value is created, and look for ways to increase value and consequently improve their business.

Secondly – and this is not news – the volume of available information is increasing every day. When Buckminster Fuller created his “Knowledge Doubling Curve”, he noticed that until 1900, human knowledge doubled every century, and by 1945 it was doubling every 25 years.

Today, it’s doubling every 12 months, and with the emergence of new markets like the Internet of Things (IoT), it is expected to double in the near future every 12 hours! Unlike Moore’s Law on computing capacity, data is following a clear exponential growth.

Knowledge is not only quantified by the amount of data, but also by its diversity. Unfortunately, our own human-based capacity does not follow the same evolution curve and the gap between the diversity of data available to us and our ability to correctly leverage it is also constantly increasing.
By the time an important piece of information reaches your desk, it may be unclear where it originated and how it changed since being created. If the data lineage isn’t clear, it’s hard to have confidence that the data itself is actually valuable, relevant or trustworthy.

In order to cope with this, we need a data governance tool that can ensure we have a clear and simple picture of the knowledge available to us, and that can deliver focus and confidence in the quality of our data.

Watch this short video to understand the fast flow of data and the data lineage tools available for you to make sense of it all.