Each project comes with 2-5 hours of micro-videos explaining the solution.
Get access to 50+ solved projects with iPython notebooks and datasets.
Add project experience to your Linkedin/Github profiles.
In this Hackerday, we will show by demonstrating how to build an ETL pipeline on streaming datasets using Kafka. We will be using the trips and fares dataset from the New York Taxi and Limousine Commission to demonstrate how to get data in real-time, join it to other streaming datasets, and store the data in a database.
Will be answering questions like reporting the income of drivers every hour, find the drivers around a certain location at any point in time amongst other things.
In this project, we are going to analyze streaming logfile dataset by integrating Kafka and Kylin.
In this big data project, we will see how data ingestion and loading is done with Kafka connect APIs while transformation will be done with Kafka Streaming API.
In this hive project, you will design a data warehouse for e-commerce environments.