Pawan Kumar Yerravelly 

Data Engineer - Capacity Supply Chain and Provisioning, Microsoft India CoE

An enthusiastic Data Engineer with a keen eye for optimal technical solutions for data-related challenges. Built efficient big data pipelines to migrate huge data from on-prem to a cloud platform. With a problem-driven mindset, developed reusable components and automation, which increased the team's productivity and reduced potential bugs.
Pawan Kumar Yerravelly profile

Projects by Pawan Kumar Yerravelly

Learn to perform 1) Twitter Sentiment Analysis using Spark Streaming, NiFi and Kafka, and 2) Build an Interactive Data Visualization for the analysis using Python Plotly.

Hive Project- Understand the various types of SCDs and implement these slowly changing dimesnsion in Hadoop Hive and Spark.

In this spark project, you will use the real-world production logs from NASA Kennedy Space Center WWW server in Florida to perform scalable log analytics with Apache Spark, Python, and Kafka.

Implement Slowly Changing Dimensions using Snowflake Method - Build Type 1 and Type 2 SCD in Snowflake using the Stream and Task Functionalities

This Project gives a detailed explanation of How Data Analytics can be used in the Retail Industry, using technologies like Sqoop, HDFS, and Hive.

Build a Real-Time Streaming Data Pipeline for an application that monitors oil wells using Apache Spark, HBase and Apache Phoenix .

In this PySpark project, you will perform airline dataset analysis using graphframes in Python to find structural motifs, the shortest route between cities, and rank airports with PageRank.