ZUMVU

pravallika Bandaru

    Added on 30 April 2019

    The History Of Big Data Hadoop?

    30 April 2019




    Introduction


    Big data term is nowadays used all over the world in every field though it is any forum or organization. Big data is nothing else but data which is in large volume that requires advanced technologies to handle as existing traditional technologies cannot manage such enormous datasets, for extracting useful value information. This extraction of significant worth items is the examination of enormous information which we call as Big Data Analytics. Read More Points on Big Data Training 


    The progressive advance in the realm of information was the presentation of social datasets which could be put away in the form of the table and which was easily processed whenever needed. The analysis over the data was done which solved many issues and made life easier. Then came the internet world and the big data era came into the picture where the problem introduced. This excessive growth was at the beginning of the 21st century. Due to excessive use of the World Wide Web we got a large volume of data with high velocity and broad variety. Such datasets were difficult to handle and the process by traditional techniques and so new data type was introduced known as big data which had all different technologies and concepts.


    Behavioral types of big data


    The data is been Categorized into many types according to


    behavior:


    Structured Data


    The data stored in relational databases table in the format of row and column. They have fixed structures and these structures are defined by organizations by creating a model. The model allows to store, process as well as gives permission to operate the data. The model defines the characteristics of data including data type and some restriction on the data gEt More Points on Big Data Online Course


    Unstructured data


    Data without any specific structure and due to this could not be stored in a row and column format is unstructured data. The data is contradictory to that of structured data. It cannot be stored

    in a databank. The volume of this data is growing extremely fast which is very tough to manage and analyze it completely


    Semi-structured data


    Data which is in the form of structured data but it does not fit the data model is semi-structured data. It cannot be stored in the form of the data table, but it can be stored in some particular types of files which hold some specific marker or tags. These markers are distinguished by

    some specific rule and the data is enforced to be stored with a ranking.



    Big data History


    Big data is a long evolution of capturing and using data and not a new phenomenon. Big data is the future activities that will bring change in the way we run the society, just like the other developments in the storage of data, processing of data and internet. The ancient history of data is when humans used tally sticks for storing and analysis of data about 18,000 BCE. The tribal peoples used to mark notches into bones or sticks for calculations, which would make them predict about how long their food would last. One of the earliest prehistoric data storage is Ishango Bone now known as Uganda which was discovered in 1960. Then in C 2400 BCE came the very first device particularly for performing calculations- Abacus. Our first libraries also appeared in this time period which represented our initial step towards mass storage.  Read More Info on Big Data Hadoop Training


    Then in the period of 300 BC-48 AD, the library containing the largest collection of data of the historic world which covered pretty much everything which we learned so far was destroyed by Romans accidentally. Then the earliest mechanical computer was discovered by Greek from C 100- 200 AD whose CPU consists of 30 bronze gears. It was designed for astrological purposes and tracking cycle of the Olympic Games. After this many small discoveries laid the

    foundation to the emergence of statistics like a first recorded experiment in statistical data analysis.


    In 1880 Hollerith Tabulating Machine was discovered that used punch cards for calculation purposes that completed 10 years of work in 3 months discovered by Herman Hollerith also called as the father of automated computation etc.




    In 1989 the first use of the term big data was done by Erik Larson in the Harpers Magazine where he said that “The keepers of big data say they are doing it for the consumer’s benefit. But data have a way of being used for purposes other originally intended”. The birth of the World Wide Web took place that kicked the internet into gear in 1991. Google search engine debut in the year 1997. After a couple of years in 1999 big data term appeared in a research paper published by the Association for Computing Machinery.


     In that storing large amounts of data and inadequate space for storage as well as analysis difficulties were highlighted. In 2001 characteristics of big data- volume, velocity, variety, was defined by Dough Laney. In 2005 creation of an open source framework- Hadoop took place for storing and analyzing big data sets. Hadoop was famous for its flexibility and management of both structured and unstructured data Get More Info On Big Data Training In Bangalore




    loader
    View More