1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com
real-time-auto-tracking-with-spark-redis.jpg

Real-time Auto Tracking with Spark-Redis

Spark Project - Discuss real-time monitoring of taxis in a city. The real-time data streaming will be simulated using Flume. The ingestion will be done using Spark Streaming.
4.74.7

Users who bought this project also bought

What will you learn

  • Key-Value (NoSQL) Databases
  • Using Redis as a pub/sub message-oriented middleware
  • Using Redis as a caching server/persistence store
  • Streaming data with Flume/Spark integration
  • Real-time processing and display of streamed data on a "dashboard".
  • Compare the capability of Redis as a pub/sub middleware with that of the industry appraised Apache Kafka.
  • How to extends the appllication to production grade.

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Prerequisites

  • Download the latest release of Redis
  • The installation will be handled in class

Project Description

The era of IOT brought with it the need to stream data, process and sometimes display its information in real or near-real time. 
In this spark streaming project, we will be using a dataset that passes for real-time data sensor feeds for tracking auto vehicles around the city of Bejing. We will track each vehicle as the signal is received from our streaming simulation (using Flume). We will receive the streams of data using Spark Streaming and use the Redis as a pub/sub middleware.

Furthermore, we will use a java swing based application to display real-time information about all vehicles being tracked. While tracking the vehicle, we will be looking for indexes like current speed, total time and distance covered.

While this spark project is about tracking autos, the principles shared in this big data project will cover wide areas of implementing real-time sensor data processing and much more IOT.

Instructors

 
Michael

Big Data & Enterprise Software Engineer

I am passionate about software development, databases, data analysis and the android platform. My native language is java but no one has stopped me so far from learning and using angular and node.js. Data and data analysis is thrilling and so are my experiences with SQL on Oracle, Microsoft SQL Server, Postgres and MyS see more...