IoT Project-Learn to design an IoT Ready Infrastructure 

IoT Project-Learn to design an IoT Ready Infrastructure 

The goal of this IoT project is to build an argument for generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

Videos

Each project comes with 2-5 hours of micro-videos explaining the solution.

Code & Dataset

Get access to 50+ solved projects with iPython notebooks and datasets.

Project Experience

Add project experience to your Linkedin/Github profiles.

Customer Love

Read All Reviews

Mike Vogt

Information Architect at Bank of America

I have had a very positive experience. The platform is very rich in resources, and the expert was thoroughly knowledgeable on the subject matter - real world hands-on experience. I wish I had this... Read More

Mohamed Yusef Ahmed

Software Developer at Taske

Recently I became interested in Hadoop as I think its a great platform for storing and analyzing large structured and unstructured data sets. The experts did a great job not only explaining the... Read More

What will you learn

A general architecture for smart IoT infrastructure
Understanding the roadmap of the project
Streaming architectures (Lambda & Kappa)
Difference between Arduino and Raspberry pie
MQTT as lightweight messaging protocol and the IOT
Understanding different SmartPipe tech and implementation software
Using Redis as Real-time-auto-tracking , etc. other than Cache system and understanding its limit
Understanding the concept of Sensor chains
Arranging the data of different components of IoT pipeline
Making the decision about MQTT-Spark Streaming vs Kafka-Spark Streaming
Configuring code to start all servers simultaneously
Creating your own virtual environment
Storing Kafka metadata causing Zookeeper
Injecting the data and performing basic EDA
Using Kafka as a data hub for streaming architecture
Extracting Data from each sensor from the HBASE and creating a chainbase
HBase and Spark Integration using the Spark HBase connector
Troubleshooting Redis and server connection
Creating a simulation environment
Using caching server to improve system performance

Project Description

In this IoT project, we will be discussing a general architecture for building smart IOT infrastructure. With the trending advance of IOT in our every facet of life, technology has enabled us to be able to handle a large amount of data ingested with high velocity. This big data project discusses IoT architecture with a sample use case.

Our use-case is a fictitious pipeline network system called SmartPipeNet which is a network of sensors with a back office control system that can monitor pipeline flow and react to events along the various branches to give production feedback, detect and reactively reduce loss, and avoid accidents. It major features include:

  • leakage detection
  • regulate supplies to the various chains of the pipeline based on certain events detection
  • predictive maintenance alerts
  • reactive regulation of pipeline flow including shutdown and restart of flow also on event detection

While we will spend time looking at the implementation as much as the IoT architecture in this big data project, our goal is to build that argument for a generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

Similar Projects

In this spark project, we will continue building the data warehouse from the previous project Yelp Data Processing Using Spark And Hive Part 1 and will do further data processing to develop diverse data products.

In this hadoop project, you will be using a sample application log file from an application server to a demonstrated scaled-down server log processing pipeline.

In this big data project, we will talk about Apache Zeppelin. We will write code, write notes, build charts and share all in one single data analytics environment using Hive, Spark and Pig.

Curriculum For This Mini Project

15th July 2017
02h 06m
16th July 2017
01h 45m