1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com
real-time-decision-using-flume-kafka.jpg

Making real time decision on incoming data using Flume and Kafka

In this project, we will work on ingesting data from a source using Apache Flume and Kafka to make a real-time decision on incoming data.
4.74.7

Users who bought this project also bought

What will you learn

  • Ingesting data with Flume
  • Building a Flume multiplexed channel selector
  • Setting up a Kafka Channel
  • Writing a Kakfa client that persist data to MySQL

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Project Description

Data is everywhere and constantly being generated around us. Using Big data tools, it is possible to ingest, process and make decisions based on data at high speed.

This project demonstrates how to use Apache Flume to ingest trading data from a source. While the default data flow is to archive all data to HDFS, Flume is also configured to channel some preconfigured symbols or trading pairs of interest to another processing server using Kafka. All the processed instructions are stored in a relational database (MySQL).

We will use following tools in this project:

Instructors

 
Michael

Big Data & Enterprise Software Engineer

I am passionate about software development, databases, data analysis and the android platform. My native language is java but no one has stopped me so far from learning and using angular and node.js. Data and data analysis is thrilling and so are my experiences with SQL on Oracle, Microsoft SQL Server, Postgres and MyS see more...