Blog

Apache Atlas provides governance capabilities for Hadoop. Apache Atlas uses both prescriptive and forensic models enriched by business taxonomical metadata. Atlas is designed to exchange… Read More »Apache Atlas Overview

Apache Kafka provided fault-tolerant, scalable messaging: Topics Producers Consumers Brokers Topics Kafka maintains feeds of messages in categories called topics. Each topic has a user-defined category… Read More »Kafka overview

Apache Flume is basically a tool or a data ingestion mechanism responsible for collecting and transporting huge amounts of data such as events, log files,… Read More »Apache Flume in Hadoop

Apache Oozie is a scheduler system used to run and manage Hadoop jobs in a distributed environment. Oozie supports combining multiple complex jobs that run… Read More »Oozie in Hadoop

It is an open source platform massively parallel processing (MPP) SQL query engine for data stored in a computer cluster running Apache Hadoop. Goals of… Read More »Impala

Sqoop is an automated set of volume data transfer tool which allows to simple import, export of data from structured based data which stores NoSql… Read More »Sqoop

Hadoop Streaming uses UNIX standard streams as the interface between Hadoop and your program so you can write Mapreduce program in any language which can… Read More »Hadoop Streaming

Apache Hive is an open-source data warehouse system that has been built on top of Hadoop. You can use Hive for analyzing and querying large datasets… Read More »Hadoop Hive

Pig Hadoop is basically a high-level programming language that is helpful for the analysis of huge datasets. Pig Hadoop was developed by Yahoo! and is… Read More »Pig in Hadoop

So, what is YARN in Hadoop? Apache YARN (Yet Another Resource Negotiator) is a resource management layer in Hadoop. YARN came into the picture with the… Read More »YARN in Hadoop

Now that you know about HDFS, it is time to talk about MapReduce. So, in this section, we’re going to learn the basic concepts of MapReduce.… Read More »MapReduce in Hadoop

Hadoop should be downloaded in the master server using the following procedure. # mkdir /opt/hadoop # cd /opt/hadoop/ # wget http://apache.mesi.com.ar/hadoop/common/hadoop-1.2.1/hadoop-1.2.0.tar.gz # tar -xzf hadoop-1.2.0.tar.gz… Read More »Installing Hadoop