Each project comes with 2-5 hours of micro-videos explaining the solution.
Code & Dataset
Get access to 50+ solved projects with iPython notebooks and datasets.
Add project experience to your Linkedin/Github profiles.
Streaming twitter using flume
Integrating flume with Spark-Streaming for processing twitter events
Data processing with Spark
Integrating Kafka to complex event alert
Integrating spark with online databases
Coordinating the data processing pipeline with Oozie
In this spark project, we are going to be building a business. Yes, a business that is similar to a IT job ad site. This Job portal will stream data from twitter to locate recently published IT jobs, process them and make them available via a simple search api. Also, to complete the circle, we will be building notification features to user who subscribe for job ads notification.
On completion of this big data project, we will provide a job portal for every IT job tweeted and provide an apply-early advantage to users.