1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com
building-end-to-end-data-warehousing-pipeline-with-kafka.jpg

Building Real-Time Data Pipelines with Kafka Connect

In this big data project, we will see how data ingestion and loading is done with Kafka connect APIs while transformation will be done with Kafka Streaming API.

Users who bought this project also bought

What will you learn

  • Kafka and Data warehousing
  • Real-time data warehousing
  • Kafka Connect API
  • Kafka Streams API
  • End-to-end Kafka pipeline

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Project Description

Lately, the phrase "ETL is dead" has become more popular. But that statement is flatly false. It should rather have been "Batch ETL is growing unpopular". Companies now believe not only in the power of data but also in the power of current-ness of data. This means that a dashboard that reveals sales pattern for yesterday is less correct than one that shows sales pattern in the last 30 minutes.

Kafka is a scalable and distributed streaming and messaging platform is a great choice for building today's ETL pipeline.

In this big data kafka project, we will see this in theory as well as implementation. We will see how data ingestion and loading is done with Kafka connect APIs while transformation will be done with Kafka Streaming API. But this is not all.

Instructors

 
Michael

Big Data & Enterprise Software Engineer

I am passionate about software development, databases, data analysis and the android platform. My native language is java but no one has stopped me so far from learning and using angular and node.js. Data and data analysis is thrilling and so are my experiences with SQL on Oracle, Microsoft SQL Server, Postgres and MyS see more...

Curriculum For This Mini Project

 
  1-Dec-2017
02:43:20
  8-Dec-2017
03:29:32