Big Data and its Impact

Still exploring its infancy, big data has been launched into our world. 

According to IBM, we create 2.5 quintillion bytes of data every day. In fact 90% of the data created has been created in the past 2 years. What does that mean, how will that impact our society and why should you care?

Machine learning, block chain, net neutrality and data mining are all new hot tech buzzwords that get dropped like we all know what they mean. I want to explore today the movement of big data as it moves its way to the center of our lives. 

For the past 40-50 years as computers and technology has developed, we have started the process of collecting to later analysis and process data. Used in business for forecasting demand of consumers, quarter over quarter comparisons, process efficiency and even money laundering. With so much amassing data every day, what is the point? With several hundred surveys in the mall you could get a sample size representative of a city and what the purchasing trends, behaviors and patterns may be with some degree of certainty. Convert that form of surveying into Pinterest "likes" "send" or "tried it" the collection of data now becomes a different view. 

No one, at this point in time, completely understands the value, potential and access that big data will have on our society. We can create millions of "what if" scenarios that solve world hunger and cure cancer. 

As the field shapes itself, where will it be classified, and will there be departments created around big data? Is the field worthy of a Chief Data Officer, some of the earliest being appointed in 2001 to eliminate some of the ambiguity around data. What competing political, social and ecological agendas will use and shape the data to support self promoting theories? 

My largest issue with news cast polls is the data. "According to the latest poll Americans believe Senator Johnson should not be convicted for murdering his mistress." (this is not a news story, only an example). They do not address who was asked, what part of the country they were from, age group, political beliefs, confidence level...

How will big data impact me, and is it worth caring about? It would seem that IT and data are now so intertwined in our lives and organizations that they are no longer separate, but a framework of our lives. Facebook, Pinterest, Instagram and others are an extension of our relationships and communication. They have woven themselves into the fabric of our lives, our cars and our homes. It is already impacting you, the choice of whether or not to care is a different discussion. 

With great data comes great responsibility. Will it branch out from targeted marketing ads to something bigger, better and much more useful? This potential has not been fully mounted or realized. With tech giants like IBM, Google, Amazon and others exploring the space with heavy investments it promises to be iMpAcTful to our future.