Yelp Data Processing using Spark and Hive Part 2

In the previous Spark Project on the same subject- Yelp Data Processing Using Spark And Hive Part 1, we began the development of Yelp dataset into domains that can easily be understood and consumed. Amongst other things we did

• Various ways to ingest data using spark
• Data transformation using Spark
• Various ways of integrating spark and hive
• Denormalize dataset into the hive tables thereby creating multiple datasets
• Discuss how to handle snapshots and incremental data loads

In this Spark project, we are going to continue building the data warehouse. The purpose in this big data project is to do further data processing to deliver different kinds of the data products.