1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com

Making real time decision on incoming data using Flume and Kafka

Hadoop Projects for Beginners -Learn data ingestion from a source using Apache Flume and Kafka to make a real-time decision on incoming data.

Users who bought this project also bought

What will you learn

  • Ingesting data with Flume
  • Building a Flume multiplexed channel selector
  • Setting up a Kafka Channel
  • Writing a Kakfa client that persist data to MySQL

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Project Description

Data is everywhere and constantly being generated around us. Using Big data tools, it is possible to ingest, process and make decisions based on data at high speed.

This big data project for beginners demonstrates how to use Apache Flume to ingest trading data from a source. While the default data flow is to archive all data to HDFS, Flume is also configured to channel some preconfigured symbols or trading pairs of interest to another processing server using Kafka. All the processed instructions are stored in a relational database (MySQL).

We will use following tools in this flume kafka project:

Curriculum For This Mini Project

05h 14m