1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com

General architecture for building IOT infrastructure

In this project, our goal is to build an argument for generalized streaming architecture for reactive data ingestion based on a microservice architecture. 

Users who bought this project also bought

What will you learn

  • Streaming architectures (Lambda & Kappa)
  • MQTT and the IOT
  • Making decision about MQTT-Spark Streaming vs Kafka-Spark Streaming
  • Using Kafka as a data hub for streaming architecture
  • HBase and Spark Integration using the Spark HBase connector
  • Using caching server to improve system performance

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Project Description

In this project, we will be discussing a general architecture for building smart IOT infrastructure. With the trending advance of IOT in our every facet of life, technology has enabled us to be able to handle a large amount of data ingested with high velocity. This project discusses this architecture with a sample use case.

Our use-case is a fictitious pipeline network system called SmartPipeNet which is a network of sensors with a back office control system that can monitor pipeline flow and react to events along the various branches to give production feedback, detect and reactively reduce loss, and avoid accidents. It major features include:

  • leakage detection
  • regulate supplies to the various chains of the pipeline based on certain events detection
  • predictive maintenance alerts
  • reactive regulation of pipeline flow including shutdown and restart of flow also on event detection

While we will spend time looking at the implementation as much as the architecture in this hackerday, our goal is to build that argument for a generalized streaming architecture for reactive data ingestion based on a microservice architecture. 



Big Data & Enterprise Software Engineer

I am passionate about software development, databases, data analysis and the android platform. My native language is java but no one has stopped me so far from learning and using angular and node.js. Data and data analysis is thrilling and so are my experiences with SQL on Oracle, Microsoft SQL Server, Postgres and MyS see more...