Is it possible to buy stock directly from a public company, bypassing a broker? It seems that discount brokers do nothing more than facilitate a trade and take a cut - I'd like to eliminate the middle man and buy from the company directly.
In this PySpark project, you will simulate a complex real-world data pipeline based on messaging. This project is deployed using the following tech stack - NiFi, PySpark, Hive, HDFS, Kafka, Airflow, Tableau and AWS QuickSight.
In this spark project, we will continue building the data warehouse from the previous project Yelp Data Processing Using Spark And Hive Part 1 and will do further data processing to develop diverse data products.