Overview and Analysis of Big Data and Hadoop

Abstract: The term "Big Data" is an evolving term that describes any amount of structured, semistructured and unstructured data that has the potential to be mined for information. Relational database management systems and desktop have difficult in handling big data. To handle these large amounts of data may require software running on tens, hundreds, or even thousands of servers". To solve these problems of making it useful for analytics purposes "Hadoop" technology is used. Hadoop technology is the core platform and for structuring Big Data. It is designed to scale up from a single server to thousands of machines, with a very high degree of fault tolerance. Hadoop is written in Java. Hadoop programs can be written using a small API in Java or Python. Hadoop provides to the application programmer the abstraction of map and reduce. Map and reduce are available in many languages, such as Lisp and Python. Keywords: Big data, Hadoop, API, RFID.