Videos
Each project comes with 2-5 hours of micro-videos explaining the solution.
Code & Dataset
Get access to 50+ solved projects with iPython notebooks and datasets.
Project Experience
Add project experience to your Linkedin/Github profiles.
Each project comes with 2-5 hours of micro-videos explaining the solution.
Get access to 50+ solved projects with iPython notebooks and datasets.
Add project experience to your Linkedin/Github profiles.
In this IoT project, we will be discussing a general architecture for building smart IOT infrastructure. With the trending advance of IOT in our every facet of life, technology has enabled us to be able to handle a large amount of data ingested with high velocity. This big data project discusses IoT architecture with a sample use case.
Our use-case is a fictitious pipeline network system called SmartPipeNet which is a network of sensors with a back office control system that can monitor pipeline flow and react to events along the various branches to give production feedback, detect and reactively reduce loss, and avoid accidents. It major features include:
While we will spend time looking at the implementation as much as the IoT architecture in this big data project, our goal is to build that argument for a generalized streaming architecture for reactive data ingestion based on a microservice architecture.
In this big data project, we will continue from a previous hive project "Data engineering on Yelp Datasets using Hadoop tools" and do the entire data processing using spark.
Spark Project - Discuss real-time monitoring of taxis in a city. The real-time data streaming will be simulated using Flume. The ingestion will be done using Spark Streaming.
In this hive project, you will design a data warehouse for e-commerce environments.