NoSQL Project on Yelp Dataset using HBase and MongoDB

NoSQL Project on Yelp Dataset using HBase and MongoDB

In this NoSQL project, we will use two NoSQL databases(HBase and MongoDB) to store Yelp business attributes and learn how to retrieve this data for processing or query.


Each project comes with 2-5 hours of micro-videos explaining the solution.

Code & Dataset

Get access to 50+ solved projects with iPython notebooks and datasets.

Project Experience

Add project experience to your Linkedin/Github profiles.

Customer Love

Read All Reviews

Shailesh Kurdekar

Solutions Architect at Capital One

I have worked for more than 15 years in Java and J2EE and have recently developed an interest in Big Data technologies and Machine learning due to a big need at my workspace. I was referred here by a... Read More

James Peebles

Data Analytics Leader, IQVIA

This is one of the best of investments you can make with regards to career progression and growth in technological knowledge. I was pointed in this direction by a mentor in the IT world who I highly... Read More

What will you learn

Why store data in a NoSQL database
Difference between sparse and densely distributed data
Understanding document-term matrix
Downloading and understanding the Yelp dataset
Writing queries in Hue-Impala for visualizing the dataset
Denormalization, its need and how to denormalize the dataset
Integrating Spark with Hive
Clustering business data based on different attributes
Revisit NoSQL databases concepts
Consistency, Availability, and Partitioning in traditional RDMS
Setting up the connection between MongoDB and Spark for collecting the data
Storing sparse business attributes in HBase
Storing sparse business attributes in MongoDB
Creating recursive function for iterating and reading the data
Using DAGS scheduler for scheduling the task to perform data analysis automatically
Integrating Hive and NoSQL databases for data retrieval using query
Integrating Spark and NoSQL databases for retrieving data for processing

Project Description

Still on the series on Data engineering using Yelp dataset, we have established several concepts - from data warehousing to graph analysis. Well done.

But in today's world, not all data are best stored on HDFS. Some special requirements and scenario could require a data storage with a very low latency that could also handle large dataset. Here comes the use of NoSQL databases.

In this NoSQL project, we will use two NoSQL databases(HBase and MongoDB) to store Yelp business attributes and also learn how to retrieve these data for processing or query. We will substantiate the value of these other ways to store data over using HDFS and how to join them with data stored in HDFS in real time.

Seeing that MongoDB is not available in Cloudera Quickstart VM, we are encouraged to install MongoDB on our host machine while setting up a host network interface between the host and the VM for this big data project.

Similar Projects

Explore hive usage efficiently in this hadoop hive project using various file formats such as JSON, CSV, ORC, AVRO and compare their relative performances

The goal of this IoT project is to build an argument for generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

This Elasticsearch example deploys the AWS ELK stack to analyse streaming event data. Tools used include Nifi, PySpark, Elasticsearch, Logstash and Kibana for visualisation.

Curriculum For This Mini Project

02h 48m
02h 59m