Design a Hadoop Architecture

Design a Hadoop Architecture

Learn to design Hadoop Architecture and understand how to store data using data acquisition tools in Hadoop.


Each project comes with 2-5 hours of micro-videos explaining the solution.

Code & Dataset

Get access to 50+ solved projects with iPython notebooks and datasets.

Project Experience

Add project experience to your Linkedin/Github profiles.

What will you learn

Learn to design Hadoop Architecture
Learn to use data acquisition tools in Hadoop to store data
Learn to write real-time queries in Apache Hive

Project Description

Assume that the web server creates a log file with timestamp and query. How will you design the Hadoop architecture (explaining how you will store the data) that can help you return top 15 queries made in the last 12 hours?

Similar Projects

In this hive project, you will work on denormalizing the JSON data and create HIVE scripts with ORC file format.

Hadoop Project- Perform basic big data analysis on airline dataset using big data tools -Pig, Hive and Impala.

In this Spark project, we are going to bring processing to the speed layer of the lambda architecture which opens up capabilities to monitor application real time performance, measure real time comfort with applications and real time alert in case of security

Curriculum For This Mini Project

Design a Hadoop Architecture