Hive Project- Denormalize JSON Data and analyse it with HIVE Scripts

In this hive project, you will work on denormalizing the JSON data and create HIVE scripts with ORC file format.
Videos
Each project comes with 2-5 hours of micro-videos explaining the solution.
Code & Dataset
Get access to 50+ solved projects with iPython notebooks and datasets.
Project Experience
Add project experience to your Linkedin/Github profiles.

What will you learn

  • Analyze JSON data
  • Loading JSON format to Hive
  • Create a Schema to the fields in the table
  • Creating queries to set up the EXTERNAL TABLE in Hive
  • Create new desired TABLE to copy the data
  • Creating query to populate and filter the data
  • Analyze log files in HIVE

Project Description

We have JSON dump(extract) with us which contains multiple details related to FSM(Field Service Management). The various details include

  • Vehicles Info
  • Crew Info
  • WorkOrders
  • Work Order transactions in a month.

We need to denormalize the JSON data and analyse using HIVE scripts.

Curriculum For This Mini Project

 
  18-Jun-2016
05h 21m