Thursday, 11 October 2018

2. Historical development of big data



  • In 1989 British computer scientist Tim Berners-Lee invented eventually the World Wide Web. He wanted to facilitate the sharing of information via a ‘hypertext’ system. Little could he know at the moment the impact of his invention.
  • As of the ‘90s, the creation of data is spurred as more and more devices are connected to the internet. In 1995 the first super-computer is built, which was able to do as much work in a second than a calculator operated by a single person can do in 30.000 years.
  • In 2005 Roger Mougalas from O’Reilly Media coined the term Big Data for the first time, only a year after they created the term Web 2.0. It refers to a large set of data that is almost impossible to manage and process using traditional business intelligence tools.
  • 2005 is also the year that Hadoop was created by Yahoo! built on top of Google’s MapReduce. Its goal was to index the entire World Wide Web and nowadays the open-source Hadoop is used by a lot of organizations to crunch through huge amounts of data. As more and more social networks start appearing and the Web 2.0 takes flight, more and more data is created on a daily basis. Innovative startups slowly start to dig into this massive amount of data and also governments start working on Big Data projects. In 2009 the Indian government decides to take an iris scan, fingerprint, and photograph of all of tis 1.2 billion inhabitants. All this data is stored in the largest biometric database in the world.
  • In 2010 Eric Schmidt speaks at the Techonomy conference in Lake Tahoe in California and he states that "there were 5 exabytes of information created by the entire world between the dawn of civilization and 2003. Now that same amount is created every two days."
  • In 2011 the McKinsey report on Big Data: The next frontier for innovation, competition, and productivity, states that in 2018 the USA alone will face a shortage of 140.000 – 190.000 data scientist as well as 1.5 million data managers.
  • In the past few years, there has been a massive increase in Big Data startups, all trying to deal with Big Data and helping organizations to understand Big Data and more and more companies are slowly adopting and moving towards Big Data. However, while it looks like Big Data is around for a long time already, in fact, Big Data is as far as the internet was in 1993. The large Big Data revolution is still ahead of us so a lot will change in the coming years. Let the Big Data era begin!
Bibliography: Datafloq.com. (2018). A Short History Of Big Data. [online] Available at: https://datafloq.com/read/big-data-history/239 [Accessed 11 Oct. 2018].

Image.slidesharecdn.com. (2018). [online] Available at: https://image.slidesharecdn.com/nrfbigdatav14-present-140113110515-phpapp01/95/how-to-get-your-brand-elected-big-data-presentation-at-nrf-by-david-selinger-5-638.jpg?cb=1389612110 [Accessed 11 Oct. 2018].



No comments:

Post a Comment

22. Google trends - how is work?

To check how Google trends works and displays big data, I followed Brexit, Donald Trump and inflation since 31 of August 2018 till9 Janu...