Each project comes with 2-5 hours of micro-videos explaining the solution.
Code & Dataset
Get access to 50+ solved projects with iPython notebooks and datasets.
Add project experience to your Linkedin/Github profiles.
Streaming architectures (Lambda & Kappa)
MQTT and the IOT
Making decision about MQTT-Spark Streaming vs Kafka-Spark Streaming
Using Kafka as a data hub for streaming architecture
HBase and Spark Integration using the Spark HBase connector
Using caching server to improve system performance
In this IoT project, we will be discussing a general architecture for building smart IOT infrastructure. With the trending advance of IOT in our every facet of life, technology has enabled us to be able to handle a large amount of data ingested with high velocity. This big data project discusses IoT architecture with a sample use case.
Our use-case is a fictitious pipeline network system called SmartPipeNet which is a network of sensors with a back office control system that can monitor pipeline flow and react to events along the various branches to give production feedback, detect and reactively reduce loss, and avoid accidents. It major features include:
While we will spend time looking at the implementation as much as the IoT architecture in this big data project, our goal is to build that argument for a generalized streaming architecture for reactive data ingestion based on a microservice architecture.