Big Data

Apache Oozie is a scheduler system used to run and manage Hadoop jobs in a distributed environment. Oozie supports combining multiple complex jobs that run… Read More »Oozie in Hadoop

It is an open source platform massively parallel processing (MPP) SQL query engine for data stored in a computer cluster running Apache Hadoop. Goals of… Read More »Impala

Sqoop is an automated set of volume data transfer tool which allows to simple import, export of data from structured based data which stores NoSql… Read More »Sqoop

Hadoop Streaming uses UNIX standard streams as the interface between Hadoop and your program so you can write Mapreduce program in any language which can… Read More »Hadoop Streaming

Apache Hive is an open-source data warehouse system that has been built on top of Hadoop. You can use Hive for analyzing and querying large datasets… Read More »Hadoop Hive

Pig Hadoop is basically a high-level programming language that is helpful for the analysis of huge datasets. Pig Hadoop was developed by Yahoo! and is… Read More »Pig in Hadoop

So, what is YARN in Hadoop? Apache YARN (Yet Another Resource Negotiator) is a resource management layer in Hadoop. YARN came into the picture with the… Read More »YARN in Hadoop

Now that you know about HDFS, it is time to talk about MapReduce. So, in this section, we’re going to learn the basic concepts of MapReduce.… Read More »MapReduce in Hadoop

Hadoop should be downloaded in the master server using the following procedure. # mkdir /opt/hadoop # cd /opt/hadoop/ # wget http://apache.mesi.com.ar/hadoop/common/hadoop-1.2.1/hadoop-1.2.0.tar.gz # tar -xzf hadoop-1.2.0.tar.gz… Read More »Installing Hadoop

Format the configured HDFS file system and then open the namenode (HDFS server) and execute the following command. $ hadoop namenode -format Start the distributed… Read More »Using HDFS

Core Hadoop ecosystem is nothing but the different components that are built on the Hadoop platform directly. However, there are a lot of complex interdependencies… Read More »Hadoop Ecosystem

Hadoop is the most important framework for working with Big Data. Hadoop biggest strength is scalability. It upgrades from working on a single node to thousands… Read More »Hadoop Introduction