IoT Project-Learn to design an IoT Ready Infrastructure 

The goal of this IoT project is to build an argument for generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

Videos

Each project comes with 2-5 hours of micro-videos explaining the solution.

Code & Dataset

Get access to 50+ solved projects with iPython notebooks and datasets.

Project Experience

Add project experience to your Linkedin/Github profiles.

What will you learn

  • Streaming architectures (Lambda & Kappa)

  • MQTT and the IOT

  • Making decision about MQTT-Spark Streaming vs Kafka-Spark Streaming

  • Using Kafka as a data hub for streaming architecture

  • HBase and Spark Integration using the Spark HBase connector

  • Using caching server to improve system performance

Project Description

In this IoT project, we will be discussing a general architecture for building smart IOT infrastructure. With the trending advance of IOT in our every facet of life, technology has enabled us to be able to handle a large amount of data ingested with high velocity. This big data project discusses IoT architecture with a sample use case.

Our use-case is a fictitious pipeline network system called SmartPipeNet which is a network of sensors with a back office control system that can monitor pipeline flow and react to events along the various branches to give production feedback, detect and reactively reduce loss, and avoid accidents. It major features include:

  • leakage detection
  • regulate supplies to the various chains of the pipeline based on certain events detection
  • predictive maintenance alerts
  • reactive regulation of pipeline flow including shutdown and restart of flow also on event detection

While we will spend time looking at the implementation as much as the IoT architecture in this big data project, our goal is to build that argument for a generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

Similar Projects

Big Data Project Implementing Slow Changing Dimensions in a Data Warehouse using Hive and Spark
Hive Project- Understand the various types of SCDs and implement these slowly changing dimesnsion in Hadoop Hive and Spark.
Big Data Project Streaming ETL in Kafka with KSQL using NYC TLC Data
In this project, we will show how to build an ETL pipeline on streaming datasets using Kafka.
Big Data Project Data Mining Project on Yelp Dataset using Hadoop Hive
Use the Hadoop ecosystem to glean valuable insights from the Yelp dataset. You will be analyzing the different patterns that can be found in the Yelp data set, to come up with various approaches in solving a business problem.
Big Data Project NoSQL Project on Yelp Dataset using HBase and MongoDB
In this NoSQL project, we will use two NoSQL databases(HBase and MongoDB) to store Yelp business attributes and learn how to retrieve this data for processing or query.

Curriculum For This Mini Project

 
  15th July 2017
02h 06m
  16th July 2017
01h 45m